-- Logs begin at Thu 2022-09-01 11:24:43 UTC, end at Thu 2022-09-01 12:38:20 UTC. -- Sep 01 11:56:10.990873 dv-cinder-839768-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 11:56:10.998940 dv-cinder-839768-4-smb devstack@keystone.service[81855]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 11:56:10 2022] *** Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: nodename: dv-cinder-839768-4-smb Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: machine: x86_64 Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: clock source: unix Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: pcre jit disabled Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: detected number of CPU cores: 4 Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: current working directory: / Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: detected binary path: /usr/bin/uwsgi-core Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: your processes number limit is 47680 Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: your memory page size is 4096 bytes Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: detected max file descriptor number: 2048 Sep 01 11:56:11.002953 dv-cinder-839768-4-smb devstack@keystone.service[81855]: lock engine: pthread robust mutexes Sep 01 11:56:11.003725 dv-cinder-839768-4-smb devstack@keystone.service[81855]: thunder lock: enabled Sep 01 11:56:11.003725 dv-cinder-839768-4-smb devstack@keystone.service[81855]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 11:56:11.003725 dv-cinder-839768-4-smb devstack@keystone.service[81855]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 11:56:11.042787 dv-cinder-839768-4-smb devstack@keystone.service[81855]: Python main interpreter initialized at 0x55e33c6719c0 Sep 01 11:56:11.042787 dv-cinder-839768-4-smb devstack@keystone.service[81855]: python threads support enabled Sep 01 11:56:11.042787 dv-cinder-839768-4-smb devstack@keystone.service[81855]: your server socket listen backlog is limited to 100 connections Sep 01 11:56:11.042787 dv-cinder-839768-4-smb devstack@keystone.service[81855]: your mercy for graceful operations on workers is 90 seconds Sep 01 11:56:11.043182 dv-cinder-839768-4-smb devstack@keystone.service[81855]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 11:56:11.043261 dv-cinder-839768-4-smb devstack@keystone.service[81855]: *** Operational MODE: preforking *** Sep 01 11:56:11.043516 dv-cinder-839768-4-smb devstack@keystone.service[81855]: *** uWSGI is running in multiple interpreter mode *** Sep 01 11:56:11.043516 dv-cinder-839768-4-smb devstack@keystone.service[81855]: spawned uWSGI master process (pid: 81855) Sep 01 11:56:11.043727 dv-cinder-839768-4-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 11:56:11.044938 dv-cinder-839768-4-smb devstack@keystone.service[81855]: spawned uWSGI worker 1 (pid: 81863, cores: 1) Sep 01 11:56:11.044938 dv-cinder-839768-4-smb devstack@keystone.service[81855]: spawned uWSGI worker 2 (pid: 81864, cores: 1) Sep 01 11:56:11.044938 dv-cinder-839768-4-smb devstack@keystone.service[81855]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 11:56:15.473756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 11:56:15.473756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: from cryptography.utils import int_from_bytes Sep 01 11:56:15.474559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 11:56:15.474559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: from cryptography.utils import int_from_bytes Sep 01 11:56:15.475205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 11:56:15.475205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: from cryptography.utils import int_from_bytes Sep 01 11:56:15.475661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 11:56:15.475661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: from cryptography.utils import int_from_bytes Sep 01 11:56:15.525951 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 11:56:15.526155 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 11:56:15.526324 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] command line args: [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 11:56:15.526594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 11:56:15.526775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ================================================================================ {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 11:56:15.527033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] admin_token = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.527307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] config_dir = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.527472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.527656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] config_source = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.527840 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] debug = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.527924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 11:56:15.528044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.528346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 11:56:15.528346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] command line args: [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 11:56:15.528468 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.528531 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 11:56:15.528593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.528737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ================================================================================ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 11:56:15.528822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.528952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] admin_token = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.529072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.529207 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] config_dir = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.529321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.529425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.529522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_config_append = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.529615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] config_source = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.529710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.529811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] debug = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.529912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_dir = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.530082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.530758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_file = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.530758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.530964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.530964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.531161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.531243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.531359 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.531439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.531566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.531646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.531772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.531853 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.531972 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_config_append = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.532057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.532129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.532198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_dir = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.532351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.532470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.532549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.532626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.532742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.532844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.532931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.533216 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.533318 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.533400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.533570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.533703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.533818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.533933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.534037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.534275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.534401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.534526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.534638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] publish_errors = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.534761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.534881 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.534995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.535114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.535234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.535353 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.535466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.535579 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.535745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.535868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.535987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] standard_threads = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.536108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.536249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.536377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.536505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.536505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.536736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] use_journal = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.536856 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.536979 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] use_json = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.537095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] publish_errors = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.537218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] use_stderr = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.537333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.537454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] use_syslog = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.537568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.537680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.537799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.537913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.538025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.538150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.538271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.538385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.538497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] standard_threads = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.538609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.538722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.538915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.539031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.539145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.539264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.539264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] use_journal = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.539482 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.539607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] use_json = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.539728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.539842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] use_stderr = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.539961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.540075 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] use_syslog = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.540188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.540327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 11:56:15.540448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.540448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.540666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.540778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.540891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.541014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.541129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.541242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.541351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.541463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.541576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.541696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.541816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.541929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.542042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.542169 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.542290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.542417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.542417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.542629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.542748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.542868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.543016 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.543270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.543461 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.543585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.543707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.543820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.543945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.544060 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.544173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.544332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.544456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.544570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.544762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.544880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.544993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.545106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.545246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.545394 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.545564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.545720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.545837 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.545837 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.546050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.546246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.546374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.546490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.546602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.546713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.546825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.546944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.547066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.547181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.547293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.547404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.547517 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.547642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.547765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.547885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.547999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.548117 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.548292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.548534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.548767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.549005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.549122 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.549236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.549383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.549506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.549629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.549752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.549851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.549946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.550048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.550145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.550249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.550379 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.550485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.550619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.550731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.550859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.551092 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.551416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.551774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.551897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.552038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.552158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.552304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.552684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.552804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.552921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.553035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.553161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.553277 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.553399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.553515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.553636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.553760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.553877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.553997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.554120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.554237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.554352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.554466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.554580 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.554694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.554816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.554930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.555084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.555201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.555314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.555437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.555552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.555666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.555781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.555894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.556009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.556123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.556307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.556426 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.556541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.556660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.556776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.556890 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.557045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.557164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.557278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.557392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.557506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.557620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.557744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.557861 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.557975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.558090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.558204 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.558318 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.558503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.558622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.558736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.558850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.558976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.559105 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.559230 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.559346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.559472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.559589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.559703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.559817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.559931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.560053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.560170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.560304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.560420 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.560534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.560658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.560658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.560885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.561000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.561115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.561237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.561353 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.561475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.561591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.561705 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.561826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.561947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.562062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.562194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.562312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.562427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.562541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.562655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.562770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.562892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.563009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.563133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.563250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.563356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.external = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.563469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.563594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.563710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.563831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.563947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.564062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.564177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.564346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.password = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.564464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.564586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.token = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.564709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.564825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.564939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.565062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.565179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.565293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.565409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.565523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.565637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.565758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.565874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.565988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.566102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.566222 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.566364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.566490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.566607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.566730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.566852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.566968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.567084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.567199 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.567314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.567437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.567556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.567671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.567786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.567907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.568023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.568146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.568275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.568392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.568518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.568636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.568752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.568875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.568999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.569115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.569230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.569353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.569470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.569594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.569712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.external = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.569827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.569942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.570057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.570173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.570297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.570414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.570537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.570664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.password = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.570781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.570896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.token = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.571019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.571146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.571262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.571377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.571492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.571608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.571800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.571919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.572034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.572149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.572296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.572421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.572548 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.572672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.572789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.572905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.573019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.573147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.573265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.573380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.573495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.573610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.573725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.573848 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.573965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.574081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.574196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.574196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.574419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.574542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.574644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.574775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.574892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.575013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.575130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.575253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.575377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.575499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.575625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.575742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.575859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.575982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.576100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.576233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.576352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.576477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.576596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.576719 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.576836 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.577433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.577549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.577664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.577780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.577903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.578021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.578137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.578265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.578382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.578498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.578622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.578739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.578860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.578860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.579078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.579194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.579317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.579434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.579549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.579665 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.579809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.579929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.580065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.580183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.580344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.580462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.580578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.580692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.580815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.580933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.581048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.581165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.581280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.581394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.581518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.581635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.581750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.581864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.581979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.582094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.582222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.582340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.582455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.582570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.582684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.582799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.582922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.583041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.583158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.583274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.583390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.583506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.583629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.583747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.583863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.583978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.584093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.584235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.584356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.584472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.584587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.584702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.584818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.584944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.585062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.585177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.585293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.585408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.585522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.585646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.585762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.585877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.585993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.586107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.586229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.586354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.586472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.586587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.586702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.586817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.586997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.587129 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.587255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.587371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.587371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.587593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.587707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.587832 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.587948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.588064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.588179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.588307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.588422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.588551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.588668 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.588783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.588898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.589013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.589128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.589252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.589368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.589485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.589600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.589715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.589829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.589952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.590069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.590184 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.590298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.590413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.590528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.590652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.590768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.590884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.590999 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.591114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.591229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.591352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.591492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.591621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.591738 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.591843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.591963 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.592088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.592253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.592374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.592489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.593231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.593354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.593485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.593593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.593709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.593824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.593946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.594062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.594186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.594303 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.594418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.594533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.594649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.594766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.594890 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.595102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.595223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.595340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.595456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.595572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.595759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.595881 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.595997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.596112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.596243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.596361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.596494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.596612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.596728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.596845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.596966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.597109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.597234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.597352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.597468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.597583 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] role.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.597698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.597813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] role.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.597939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.598056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.598171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.598286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.598402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.598525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.598643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.598764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.598886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.599004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.599120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.599243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.599361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.599477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.599592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.599707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.599823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.599945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.600064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.600179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.600369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.600485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.600601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.600728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.600846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.600961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.601077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.601193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.601308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.601308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.601535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.601656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.601772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.601887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.602003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.602129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.602246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.602368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.602484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.602599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.602714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.602838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.602955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.603070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.603190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.603190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.603407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.603529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.603646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.603762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.603877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.603993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.604108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.604250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.604370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.604485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.604601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] role.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.604715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.604830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] role.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.604957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.605075 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.605191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.605307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.605422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.605537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.605661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.605778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.605893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.606009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.606124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.606247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.606365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.606481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.606597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.606712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.606827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.606951 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.607067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.607182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.607300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.607415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.607530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.607653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.607770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.607885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.608001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.608135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.608294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.608294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.608530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.608646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.608761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.608876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.608974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.609101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.609219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.609334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.609465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.609591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.609591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.609810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.609925 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.connection = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.610049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.610166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.610283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.610398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.610515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.610639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.610757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.610873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.610989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.611104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.611219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.611342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.611459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.611576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.611692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.611807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.611929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.612054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.612171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.612304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.612421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.612536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.612653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.612779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.612897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.613013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.613138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.613256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.613371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.613495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.613614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.613729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.613845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.613960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.614076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.614200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.614317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.614416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 11:56:15.614530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.614530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.614530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.614855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.614855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.615072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.615293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.615544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.615830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.616068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.616343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.616617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.616883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.617133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.617386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.617664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.617879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.618130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.618382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.618627 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.618880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.619156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.619402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.619654 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.619941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.620227 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.620495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.620767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.621028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.621313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.621593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 11:56:15.621835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 11:56:15.643664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.643892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.644125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.647681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.647919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.648147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.652686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.657660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.681558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.681873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.684911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.684911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.736684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.737728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.786514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.786742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.788602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.788844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.944844 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.945080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.945299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.945524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.945748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.945974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.947177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.947420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.947647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.947873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.948095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.948342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.969449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.969685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.969917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.970014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.970144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.970228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.970366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.970448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.970586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.970670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.970807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.970908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.971083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.971303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.981956 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.982558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.995003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.995151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.995375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.995596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.995682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.995808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.995887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.996008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.996096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.996262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.996351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.996575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.996797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:15.997018 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 11:56:16.013607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.013819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 11:56:16.014143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.014229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.014371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 11:56:16.014504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 11:56:16.015189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.015456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.015586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.015723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.015821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 11:56:16.015980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.016061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.016351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.016622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.016887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.025591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.025879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.026156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.026271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.026448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.026568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.026847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.027162 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.033966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.034807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.036880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.037172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.037462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.037752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.037974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.038113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.038261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.038388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.038515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.038640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.038761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.038891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.039016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.039137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.039259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.039379 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.039515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.039641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.039769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.040029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.040342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.040625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.063055 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.064080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.064568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.064860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.065596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.065890 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.069404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.069692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.069977 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.070558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.070849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.071143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.076479 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.076770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.077526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.077820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.080753 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.081054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.081344 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.081632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.081914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.082043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.082211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.082499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.082788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.083073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.083355 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.083629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.083902 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.084008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.084279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.084567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.100448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.100725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.101743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.102026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.104552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.106037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.107597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.107899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.109815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.110118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.112770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.114344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.115841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.117610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.118921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.119227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.119516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.119803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.120085 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.120494 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.120729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.121039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.121325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.121630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.121910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.122206 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.136317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.136617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.136894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.137162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.138076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.138382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.138659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.138930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.144436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.146105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.146400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.147655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.147937 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.148021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.149515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.149804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.150629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.150919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.151209 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.151497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.151797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.152591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.152884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.153183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.153479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.153780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.163623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.163924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.164234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.164520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.164808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.165084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.165375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.165711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.166008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.166295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.166580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.166866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.167160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.167452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.181582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.183865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.184650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.187458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.188091 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.189568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.190373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.191043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.191330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.191616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.191954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.193478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.193766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.194056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.198464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.199953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.200480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.202154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.202997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.203290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.203575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.203854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.205069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.205372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.205663 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.205947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.211800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.212097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.212433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.214030 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.214332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.214621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.219465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.219758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.220042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.220350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.220631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.220909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.221186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.221471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.221555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 11:56:16.221754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.221847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.222035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.222118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.222311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.222393 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.222583 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.222724 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.222849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.222936 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.223127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.223211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.223445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.223839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.224124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.224432 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.224703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.224977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.225263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 11:56:16.260924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e33c6719c0 pid: 81863 (default app) Sep 01 11:56:16.264369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f30eb2-3ab7-4c1e-84de-4c21b508d460 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:16.264671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f30eb2-3ab7-4c1e-84de-4c21b508d460 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:16.264945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f30eb2-3ab7-4c1e-84de-4c21b508d460 None None] PATH_INFO: `/v3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:16.265051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e33c6719c0 pid: 81864 (default app) Sep 01 11:56:16.269389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Thu Sep 1 11:56:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:24.231538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b45436-b27c-49c9-8d49-b4bc40ffafba None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:24.232098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b45436-b27c-49c9-8d49-b4bc40ffafba None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:24.232098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b45436-b27c-49c9-8d49-b4bc40ffafba None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:24.236538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:56:24.241767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:24.242293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:24.242390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:24.312854 dv-cinder-839768-4-smb devstack@keystone.service[81863]: INFO dbcounter [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] Registered counter for database keystone Sep 01 11:56:24.334592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG oslo_db.sqlalchemy.engines [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 11:56:24.340794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writer thread running {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 11:56:24.521762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG passlib.handlers.bcrypt [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81863) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 11:56:24.522066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG passlib.handlers.bcrypt [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81863) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 11:56:24.580913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:24.582551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:24.713738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 11:56:25.200557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b45436-b27c-49c9-8d49-b4bc40ffafba None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:25.271126 dv-cinder-839768-4-smb devstack@keystone.service[81864]: INFO dbcounter [None req-63b45436-b27c-49c9-8d49-b4bc40ffafba None None] Registered counter for database keystone Sep 01 11:56:25.290629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG oslo_db.sqlalchemy.engines [None req-63b45436-b27c-49c9-8d49-b4bc40ffafba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 11:56:25.296938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writer thread running {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 11:56:25.417632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b45436-b27c-49c9-8d49-b4bc40ffafba None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:25.422039 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697eb7c-cdfc-4480-894f-918f308a4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:25.425449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697eb7c-cdfc-4480-894f-918f308a4920 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:25.425449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697eb7c-cdfc-4480-894f-918f308a4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:25.425449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697eb7c-cdfc-4480-894f-918f308a4920 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:25.433666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697eb7c-cdfc-4480-894f-918f308a4920 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:25.486315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8697eb7c-cdfc-4480-894f-918f308a4920 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 11:56:25.486583 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697eb7c-cdfc-4480-894f-918f308a4920 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:25.496877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Sep 1 11:56:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 11:56:25.502928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:25.517738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17d2a-22a7-44cb-b49a-f4ec27ba2260 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:25.522140 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33811f-ea1d-4910-a168-3f5b795e9122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:25.523235 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33811f-ea1d-4910-a168-3f5b795e9122 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:25.523550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33811f-ea1d-4910-a168-3f5b795e9122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:25.523824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33811f-ea1d-4910-a168-3f5b795e9122 admin admin] PATH_INFO: `/v3/projects/8fa27a3f862749599654d7d59ff48c18` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:25.525451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33811f-ea1d-4910-a168-3f5b795e9122 admin admin] RBAC: Authorizing `identity:get_project(project_id=8fa27a3f862749599654d7d59ff48c18)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:25.579162 dv-cinder-839768-4-smb devstack@keystone.service[81863]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba33811f-ea1d-4910-a168-3f5b795e9122 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 11:56:25.579507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33811f-ea1d-4910-a168-3f5b795e9122 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:25.584112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Sep 1 11:56:25 2022] GET /identity/v3/projects/8fa27a3f862749599654d7d59ff48c18 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:27.486206 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892366e9-e4af-4a90-86e7-b398d3196417 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:27.486750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892366e9-e4af-4a90-86e7-b398d3196417 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:27.486750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892366e9-e4af-4a90-86e7-b398d3196417 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:27.490987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:27.496491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0a96a-64f3-4e99-92a4-a4ea2c12a104 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:27.496923 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0a96a-64f3-4e99-92a4-a4ea2c12a104 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:27.497049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0a96a-64f3-4e99-92a4-a4ea2c12a104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:27.517540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4dc0a96a-64f3-4e99-92a4-a4ea2c12a104 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:27.519058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4dc0a96a-64f3-4e99-92a4-a4ea2c12a104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:27.526969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 11:56:27.791693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892366e9-e4af-4a90-86e7-b398d3196417 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:27.804693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892366e9-e4af-4a90-86e7-b398d3196417 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:27.808955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d03c5-661a-48c4-9fcf-572823200a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:27.809549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d03c5-661a-48c4-9fcf-572823200a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:27.809831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d03c5-661a-48c4-9fcf-572823200a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:27.810101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d03c5-661a-48c4-9fcf-572823200a4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:27.817742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d03c5-661a-48c4-9fcf-572823200a4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:27.819499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d03c5-661a-48c4-9fcf-572823200a4d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:27.828047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Sep 1 11:56:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 11:56:27.833441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0a96a-64f3-4e99-92a4-a4ea2c12a104 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:27.842928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0a96a-64f3-4e99-92a4-a4ea2c12a104 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:27.847269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e42d59-fee1-45e4-80e9-d713a7bb3fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:27.847892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e42d59-fee1-45e4-80e9-d713a7bb3fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:27.848177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e42d59-fee1-45e4-80e9-d713a7bb3fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:27.848480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e42d59-fee1-45e4-80e9-d713a7bb3fe2 admin admin] PATH_INFO: `/v3/users/05e7d4149924497faf197737573abc5d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:27.849773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e42d59-fee1-45e4-80e9-d713a7bb3fe2 admin admin] RBAC: Authorizing `identity:get_user(user_id=05e7d4149924497faf197737573abc5d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:27.851592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e42d59-fee1-45e4-80e9-d713a7bb3fe2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:27.853155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Thu Sep 1 11:56:27 2022] GET /identity/v3/users/05e7d4149924497faf197737573abc5d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:29.835223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4236ff4-4bb3-4ebe-9a98-e7c500308334 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:29.835735 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4236ff4-4bb3-4ebe-9a98-e7c500308334 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:29.835816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4236ff4-4bb3-4ebe-9a98-e7c500308334 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:29.837138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:56:29.843095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe80b15-0e68-410f-a2f4-413f2d7d78c7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:29.843530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe80b15-0e68-410f-a2f4-413f2d7d78c7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:29.843778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe80b15-0e68-410f-a2f4-413f2d7d78c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:29.862096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4fe80b15-0e68-410f-a2f4-413f2d7d78c7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:29.863263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4fe80b15-0e68-410f-a2f4-413f2d7d78c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:29.874259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d7aa-6efb-4487-bc72-2e29f2ed6155 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:29.874539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d7aa-6efb-4487-bc72-2e29f2ed6155 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:29.874814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d7aa-6efb-4487-bc72-2e29f2ed6155 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:29.876240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:56:29.881446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a514-ed87-424c-891c-f4b405fe76d2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:29.881811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a514-ed87-424c-891c-f4b405fe76d2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:29.882100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a514-ed87-424c-891c-f4b405fe76d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:29.925141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG passlib.handlers.bcrypt [None req-c460a514-ed87-424c-891c-f4b405fe76d2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81864) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 11:56:29.925535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG passlib.handlers.bcrypt [None req-c460a514-ed87-424c-891c-f4b405fe76d2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81864) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 11:56:29.946249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:29.975564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c460a514-ed87-424c-891c-f4b405fe76d2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:29.977210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c460a514-ed87-424c-891c-f4b405fe76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:30.083960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:56:30.216310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe80b15-0e68-410f-a2f4-413f2d7d78c7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:30.242212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:30.326308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe80b15-0e68-410f-a2f4-413f2d7d78c7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:30.350466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a514-ed87-424c-891c-f4b405fe76d2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:30.361070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05c44-8f18-446f-9fd6-17ff44ed8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:30.361719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05c44-8f18-446f-9fd6-17ff44ed8e8e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:30.362004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05c44-8f18-446f-9fd6-17ff44ed8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:30.362287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05c44-8f18-446f-9fd6-17ff44ed8e8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:30.373770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c05c44-8f18-446f-9fd6-17ff44ed8e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-07c05c44-8f18-446f-9fd6-17ff44ed8e8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:30.382744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:30.383600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:56:30.384672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:30.390150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05c44-8f18-446f-9fd6-17ff44ed8e8e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:30.461734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a514-ed87-424c-891c-f4b405fe76d2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:30.464265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:30.479488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:30.497782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05c44-8f18-446f-9fd6-17ff44ed8e8e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:30.502196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4de4b-ea80-4370-a785-f928f6cbd66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:30.503071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4de4b-ea80-4370-a785-f928f6cbd66f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:30.503358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4de4b-ea80-4370-a785-f928f6cbd66f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:30.503637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4de4b-ea80-4370-a785-f928f6cbd66f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:30.535524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef883267-9f66-4414-be0c-60faa8a5d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:30.536146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef883267-9f66-4414-be0c-60faa8a5d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:30.536497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef883267-9f66-4414-be0c-60faa8a5d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:30.536784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef883267-9f66-4414-be0c-60faa8a5d1c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:30.537508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef883267-9f66-4414-be0c-60faa8a5d1c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:30.537814 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef883267-9f66-4414-be0c-60faa8a5d1c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:30.539240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef883267-9f66-4414-be0c-60faa8a5d1c5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:30.553249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:56:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:30.558945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef883267-9f66-4414-be0c-60faa8a5d1c5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:30.580253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4de4b-ea80-4370-a785-f928f6cbd66f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:30.581785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4de4b-ea80-4370-a785-f928f6cbd66f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:30.682794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef883267-9f66-4414-be0c-60faa8a5d1c5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:30.702090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 11:56:30.707719 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4de4b-ea80-4370-a785-f928f6cbd66f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:30.710680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:30.726977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45a1c7-6da3-48e2-b404-a97509e7ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:30.727633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45a1c7-6da3-48e2-b404-a97509e7ae19 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:30.727915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45a1c7-6da3-48e2-b404-a97509e7ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:30.728195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45a1c7-6da3-48e2-b404-a97509e7ae19 None admin] PATH_INFO: `/v3/users/05e7d4149924497faf197737573abc5d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:30.729442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45a1c7-6da3-48e2-b404-a97509e7ae19 None admin] RBAC: Authorizing `identity:get_user(user_id=05e7d4149924497faf197737573abc5d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:30.730963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45a1c7-6da3-48e2-b404-a97509e7ae19 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:30.732614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:30 2022] GET /identity/v3/users/05e7d4149924497faf197737573abc5d => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:30.738499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45a1c7-6da3-48e2-b404-a97509e7ae19 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:30.754392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:30.826826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4de4b-ea80-4370-a785-f928f6cbd66f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:30.849244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45a1c7-6da3-48e2-b404-a97509e7ae19 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:30.865562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13716c03-4208-4e3b-882f-65b0840fa17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:30.866432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13716c03-4208-4e3b-882f-65b0840fa17e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:30.866707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13716c03-4208-4e3b-882f-65b0840fa17e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:30.866979 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13716c03-4208-4e3b-882f-65b0840fa17e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:30.887197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a0ce-d2d8-4542-86b1-7c57b09855cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:30.887833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a0ce-d2d8-4542-86b1-7c57b09855cc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:30.888111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a0ce-d2d8-4542-86b1-7c57b09855cc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:30.888436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a0ce-d2d8-4542-86b1-7c57b09855cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:30.890213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572a0ce-d2d8-4542-86b1-7c57b09855cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:30.891669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572a0ce-d2d8-4542-86b1-7c57b09855cc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:30.893264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:30.899402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a0ce-d2d8-4542-86b1-7c57b09855cc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:30.900612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13716c03-4208-4e3b-882f-65b0840fa17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:30.902720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13716c03-4208-4e3b-882f-65b0840fa17e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-13716c03-4208-4e3b-882f-65b0840fa17e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:56:30.922535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:30.923503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:56:30.924411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:56:30.924411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:56:30.924411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:56:30.924411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:56:30.930584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13716c03-4208-4e3b-882f-65b0840fa17e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:31.002451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:31.011960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:31.023053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a0ce-d2d8-4542-86b1-7c57b09855cc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:31.067233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b063d-fbf4-4c34-b8c9-643369eba99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:31.068221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b063d-fbf4-4c34-b8c9-643369eba99e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:31.068833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b063d-fbf4-4c34-b8c9-643369eba99e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:31.069296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b063d-fbf4-4c34-b8c9-643369eba99e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:31.070553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b063d-fbf4-4c34-b8c9-643369eba99e None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.domain.id=default, user.id=05e7d4149924497faf197737573abc5d) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:31.071073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b063d-fbf4-4c34-b8c9-643369eba99e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:31.073394 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b063d-fbf4-4c34-b8c9-643369eba99e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:31.077631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13716c03-4208-4e3b-882f-65b0840fa17e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:31.083533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Sep 1 11:56:30 2022] GET /identity/v3/role_assignments?user.id=05e7d4149924497faf197737573abc5d&scope.domain.id=default&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 233 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:31.121569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fcb78-573e-41a6-93de-3c901866d291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:31.122370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fcb78-573e-41a6-93de-3c901866d291 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:31.122766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fcb78-573e-41a6-93de-3c901866d291 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:31.123187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fcb78-573e-41a6-93de-3c901866d291 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:31.123996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fcb78-573e-41a6-93de-3c901866d291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:31.124474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fcb78-573e-41a6-93de-3c901866d291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:31.126114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fcb78-573e-41a6-93de-3c901866d291 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:31.147456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:33.423007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988f35a-1de4-4160-984a-6bfc47912ca7 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:33.424039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988f35a-1de4-4160-984a-6bfc47912ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:33.424590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988f35a-1de4-4160-984a-6bfc47912ca7 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:33.426151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:33.432453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bc40b-3372-434c-9c58-5a4e866a638f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:33.433395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bc40b-3372-434c-9c58-5a4e866a638f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:33.433884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bc40b-3372-434c-9c58-5a4e866a638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:33.459327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fc0bc40b-3372-434c-9c58-5a4e866a638f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:33.460923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fc0bc40b-3372-434c-9c58-5a4e866a638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:33.546275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:56:33.735877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df8518-080e-426b-b9e7-b470e9878340 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:33.737464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df8518-080e-426b-b9e7-b470e9878340 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:33.737464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df8518-080e-426b-b9e7-b470e9878340 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:33.738516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:56:33.750309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b1f8-5a9c-4513-839d-1101687cbf3d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:33.750950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b1f8-5a9c-4513-839d-1101687cbf3d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:33.751447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b1f8-5a9c-4513-839d-1101687cbf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:33.776624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8d92b1f8-5a9c-4513-839d-1101687cbf3d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:33.778163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8d92b1f8-5a9c-4513-839d-1101687cbf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:33.837294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:33.870284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 12/25] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:34.097333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df8518-080e-426b-b9e7-b470e9878340 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:34.237674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df8518-080e-426b-b9e7-b470e9878340 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:34.285691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926e103-6248-495a-8640-765a62b86775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:34.286734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e103-6248-495a-8640-765a62b86775 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:34.287230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e103-6248-495a-8640-765a62b86775 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:34.287703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e103-6248-495a-8640-765a62b86775 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:34.307697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b1f8-5a9c-4513-839d-1101687cbf3d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:34.308955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926e103-6248-495a-8640-765a62b86775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b926e103-6248-495a-8640-765a62b86775 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:34.314606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:34.315488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:56:34.316686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 14/26] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:56:34.324097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926e103-6248-495a-8640-765a62b86775 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:34.328587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:34.488695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926e103-6248-495a-8640-765a62b86775 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:34.540727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b1f8-5a9c-4513-839d-1101687cbf3d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:34.550410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94d0de-5aaa-4781-bc64-30447de14057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:34.551356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94d0de-5aaa-4781-bc64-30447de14057 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:34.552071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94d0de-5aaa-4781-bc64-30447de14057 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:34.552550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94d0de-5aaa-4781-bc64-30447de14057 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:34.553392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94d0de-5aaa-4781-bc64-30447de14057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:34.553871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94d0de-5aaa-4781-bc64-30447de14057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:34.555420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94d0de-5aaa-4781-bc64-30447de14057 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:34.568067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 15/27] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:56:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:34.569723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fda1fc-71c6-438c-abb7-82c0614d0654 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:34.570178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fda1fc-71c6-438c-abb7-82c0614d0654 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:34.570597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fda1fc-71c6-438c-abb7-82c0614d0654 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:34.577285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 16/28] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:34.579043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02162-c79d-4525-9f1c-56a7421027e8 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:34.579529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02162-c79d-4525-9f1c-56a7421027e8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:34.580016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02162-c79d-4525-9f1c-56a7421027e8 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:34.583065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 17/29] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:34.584591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c02162-c79d-4525-9f1c-56a7421027e8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:34.611613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d46c9-d7ed-41da-baa5-15cfca624dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:34.612716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d46c9-d7ed-41da-baa5-15cfca624dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:34.613241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d46c9-d7ed-41da-baa5-15cfca624dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:34.613734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d46c9-d7ed-41da-baa5-15cfca624dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:34.626369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d46c9-d7ed-41da-baa5-15cfca624dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:34.628407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d46c9-d7ed-41da-baa5-15cfca624dd9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a71d46c9-d7ed-41da-baa5-15cfca624dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:56:34.646084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:34.646995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:56:34.647765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:56:34.647765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:56:34.647765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:56:34.655247 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 13/30] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:34.655247 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6242ef1-e93b-40b8-bbab-7e39a03f8146 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:34.656355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6242ef1-e93b-40b8-bbab-7e39a03f8146 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:34.657011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6242ef1-e93b-40b8-bbab-7e39a03f8146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:34.678761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b6242ef1-e93b-40b8-bbab-7e39a03f8146 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:34.680431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b6242ef1-e93b-40b8-bbab-7e39a03f8146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:34.707580 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:34.764692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 14/31] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:34.766307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc278c-3e6d-4aa6-89c1-874c374ee3f8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:34.766706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc278c-3e6d-4aa6-89c1-874c374ee3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:34.767210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc278c-3e6d-4aa6-89c1-874c374ee3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:34.796072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c02162-c79d-4525-9f1c-56a7421027e8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:34.809464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ccfc278c-3e6d-4aa6-89c1-874c374ee3f8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:34.811520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ccfc278c-3e6d-4aa6-89c1-874c374ee3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:34.828486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:34.864032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054092f-2b3f-4034-b3d9-5d3dd76de6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:34.865517 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054092f-2b3f-4034-b3d9-5d3dd76de6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:34.866471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054092f-2b3f-4034-b3d9-5d3dd76de6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:34.867331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054092f-2b3f-4034-b3d9-5d3dd76de6e7 None admin] PATH_INFO: `/v3/users/05e7d4149924497faf197737573abc5d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:34.869840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054092f-2b3f-4034-b3d9-5d3dd76de6e7 None admin] RBAC: Authorizing `identity:get_user(user_id=05e7d4149924497faf197737573abc5d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:34.873398 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054092f-2b3f-4034-b3d9-5d3dd76de6e7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:34.876530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 18/32] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:34 2022] GET /identity/v3/users/05e7d4149924497faf197737573abc5d => generated 247 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:34.884673 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054092f-2b3f-4034-b3d9-5d3dd76de6e7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:35.031188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 15/33] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:35.032632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc278c-3e6d-4aa6-89c1-874c374ee3f8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:35.102121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054092f-2b3f-4034-b3d9-5d3dd76de6e7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:35.165657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7700d4-02a3-4894-8c4b-9710b8540ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:35.166286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7700d4-02a3-4894-8c4b-9710b8540ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:35.166565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7700d4-02a3-4894-8c4b-9710b8540ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:35.166837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7700d4-02a3-4894-8c4b-9710b8540ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:35.167486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7700d4-02a3-4894-8c4b-9710b8540ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:35.167789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7700d4-02a3-4894-8c4b-9710b8540ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:35.169514 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7700d4-02a3-4894-8c4b-9710b8540ca7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:35.172033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:35.194671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:35.199968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 19/34] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:35.202649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429053-c20a-4a2f-85c3-ee03ca979449 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:35.203439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429053-c20a-4a2f-85c3-ee03ca979449 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:35.204193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429053-c20a-4a2f-85c3-ee03ca979449 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:35.206990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 20/35] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:35.208981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429053-c20a-4a2f-85c3-ee03ca979449 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:35.213498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc278c-3e6d-4aa6-89c1-874c374ee3f8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:35.261432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3bb79-6129-4ed6-91c4-1a308f01ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:35.263901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3bb79-6129-4ed6-91c4-1a308f01ad1f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:35.265014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3bb79-6129-4ed6-91c4-1a308f01ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:35.266177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3bb79-6129-4ed6-91c4-1a308f01ad1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:35.270533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3bb79-6129-4ed6-91c4-1a308f01ad1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:35.275759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3bb79-6129-4ed6-91c4-1a308f01ad1f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:35.279768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 16/36] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:35.281705 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3bb79-6129-4ed6-91c4-1a308f01ad1f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:35.407089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429053-c20a-4a2f-85c3-ee03ca979449 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:35.408992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3bb79-6129-4ed6-91c4-1a308f01ad1f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:35.446716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550ccbd-a6c7-4a0e-9bb7-8cd0e8fa3f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:35.447364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550ccbd-a6c7-4a0e-9bb7-8cd0e8fa3f03 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:35.447661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550ccbd-a6c7-4a0e-9bb7-8cd0e8fa3f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:35.447954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550ccbd-a6c7-4a0e-9bb7-8cd0e8fa3f03 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:35.448687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550ccbd-a6c7-4a0e-9bb7-8cd0e8fa3f03 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:35.450121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550ccbd-a6c7-4a0e-9bb7-8cd0e8fa3f03 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:35.472412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393942-b790-4cf1-87f3-3362d538ce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:35.473054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393942-b790-4cf1-87f3-3362d538ce85 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:35.474746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393942-b790-4cf1-87f3-3362d538ce85 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:35.474746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393942-b790-4cf1-87f3-3362d538ce85 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:35.474746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5393942-b790-4cf1-87f3-3362d538ce85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:35.475969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5393942-b790-4cf1-87f3-3362d538ce85 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:35.665709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 21/37] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Sep 1 11:56:35 2022] POST /identity/v3/roles => generated 225 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:56:35.667307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a6c89-6581-4f40-a5ac-52e5d9fc5804 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:35.667657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a6c89-6581-4f40-a5ac-52e5d9fc5804 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:35.667892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a6c89-6581-4f40-a5ac-52e5d9fc5804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:35.703584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-002a6c89-6581-4f40-a5ac-52e5d9fc5804 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:35.706407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-002a6c89-6581-4f40-a5ac-52e5d9fc5804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:35.743279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 17/38] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:56:35 2022] POST /identity/v3/projects => generated 301 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:56:35.746438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393942-b790-4cf1-87f3-3362d538ce85 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:35.786056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:35.864597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:35.900388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 22/39] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:35.901389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a6c89-6581-4f40-a5ac-52e5d9fc5804 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:36.033178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393942-b790-4cf1-87f3-3362d538ce85 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:36.111552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11843c59-f2d9-417a-a445-09db64596c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:36.112673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11843c59-f2d9-417a-a445-09db64596c5b None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:36.113162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11843c59-f2d9-417a-a445-09db64596c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:36.113651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11843c59-f2d9-417a-a445-09db64596c5b None admin] PATH_INFO: `/v3/domains/default/users/05e7d4149924497faf197737573abc5d/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:36.117779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11843c59-f2d9-417a-a445-09db64596c5b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=05e7d4149924497faf197737573abc5d, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:36.120628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11843c59-f2d9-417a-a445-09db64596c5b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:36.144906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a6c89-6581-4f40-a5ac-52e5d9fc5804 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:36.197962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc5d46-e064-46e4-b8c3-df57ca8e6a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:36.198768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc5d46-e064-46e4-b8c3-df57ca8e6a21 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:36.199220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc5d46-e064-46e4-b8c3-df57ca8e6a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:36.199809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc5d46-e064-46e4-b8c3-df57ca8e6a21 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:36.200795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc5d46-e064-46e4-b8c3-df57ca8e6a21 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:36.202492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc5d46-e064-46e4-b8c3-df57ca8e6a21 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:36.247379 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 18/40] 10.222.0.18 () {58 vars in 1361 bytes} [Thu Sep 1 11:56:35 2022] PUT /identity/v3/domains/default/users/05e7d4149924497faf197737573abc5d/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:56:36.249688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeda89-555b-4a22-b7fb-e269c4711fa8 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:36.250051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeda89-555b-4a22-b7fb-e269c4711fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:36.250407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeda89-555b-4a22-b7fb-e269c4711fa8 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:36.256285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 19/41] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:36.259870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bce43-5772-4001-8676-e749ebaba427 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:36.260339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bce43-5772-4001-8676-e749ebaba427 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:36.260747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bce43-5772-4001-8676-e749ebaba427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:36.284367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 23/42] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Sep 1 11:56:35 2022] POST /identity/v3/roles => generated 219 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:56:36.296384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-069bce43-5772-4001-8676-e749ebaba427 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:36.296384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-069bce43-5772-4001-8676-e749ebaba427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:36.415063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:36.424547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 20/43] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:56:36.484652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc5d46-e064-46e4-b8c3-df57ca8e6a21 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:36.734065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:36.844576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc5d46-e064-46e4-b8c3-df57ca8e6a21 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:36.870751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bce43-5772-4001-8676-e749ebaba427 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:36.908378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c4c40-89c5-4d6a-a96f-88a526430cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:36.909280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c4c40-89c5-4d6a-a96f-88a526430cdd None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:36.909736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c4c40-89c5-4d6a-a96f-88a526430cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:36.910137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c4c40-89c5-4d6a-a96f-88a526430cdd None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:36.910962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c4c40-89c5-4d6a-a96f-88a526430cdd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:36.912788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c4c40-89c5-4d6a-a96f-88a526430cdd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:37.016359 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 24/44] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Sep 1 11:56:36 2022] POST /identity/v3/roles => generated 223 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:56:37.046267 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bce43-5772-4001-8676-e749ebaba427 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:37.089575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2631a-2b58-4cfd-911c-df4d51f8a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:37.090267 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2631a-2b58-4cfd-911c-df4d51f8a723 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:37.090510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2631a-2b58-4cfd-911c-df4d51f8a723 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:37.090802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2631a-2b58-4cfd-911c-df4d51f8a723 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:37.095620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2631a-2b58-4cfd-911c-df4d51f8a723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:37.095620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2631a-2b58-4cfd-911c-df4d51f8a723 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:37.097024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 21/45] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:37.102803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c4c40-89c5-4d6a-a96f-88a526430cdd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:37.274977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c4c40-89c5-4d6a-a96f-88a526430cdd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:37.277809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:37.335191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f62b10-550d-4c80-a743-918f32d03e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:37.335975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f62b10-550d-4c80-a743-918f32d03e53 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:37.336442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f62b10-550d-4c80-a743-918f32d03e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:37.336868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f62b10-550d-4c80-a743-918f32d03e53 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:37.337674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f62b10-550d-4c80-a743-918f32d03e53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:37.339330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f62b10-550d-4c80-a743-918f32d03e53 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:37.440961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 25/46] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:56:37 2022] POST /identity/v3/projects => generated 312 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:56:38.327033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adecdd-80a4-4f14-813b-a7e900a9b77a None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:38.327559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adecdd-80a4-4f14-813b-a7e900a9b77a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:38.327687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adecdd-80a4-4f14-813b-a7e900a9b77a None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:38.328992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 22/47] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:38.334712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5cc72-b147-4ff4-a98e-11699ca2b770 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:38.335269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5cc72-b147-4ff4-a98e-11699ca2b770 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:38.335269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5cc72-b147-4ff4-a98e-11699ca2b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:38.354284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-06f5cc72-b147-4ff4-a98e-11699ca2b770 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:38.355488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-06f5cc72-b147-4ff4-a98e-11699ca2b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:38.423644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 26/48] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:38.691688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adecdd-80a4-4f14-813b-a7e900a9b77a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:38.761996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:38.798704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adecdd-80a4-4f14-813b-a7e900a9b77a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:38.842906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9d27-ac0e-477f-b3de-e365b63e0fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:38.843550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9d27-ac0e-477f-b3de-e365b63e0fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:38.843838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9d27-ac0e-477f-b3de-e365b63e0fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:38.844118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9d27-ac0e-477f-b3de-e365b63e0fd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:38.856171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc9d27-ac0e-477f-b3de-e365b63e0fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-cabc9d27-ac0e-477f-b3de-e365b63e0fd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:38.862332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:38.863205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:56:38.864056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 23/49] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:56:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:38.871386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5cc72-b147-4ff4-a98e-11699ca2b770 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:38.963916 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:38.979321 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5cc72-b147-4ff4-a98e-11699ca2b770 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:39.016545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dfece-d838-4982-b9d2-4eb50d8c179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:39.017210 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dfece-d838-4982-b9d2-4eb50d8c179d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:39.017491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dfece-d838-4982-b9d2-4eb50d8c179d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:39.017762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dfece-d838-4982-b9d2-4eb50d8c179d None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:39.018446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dfece-d838-4982-b9d2-4eb50d8c179d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:39.018746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dfece-d838-4982-b9d2-4eb50d8c179d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:39.020151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dfece-d838-4982-b9d2-4eb50d8c179d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:39.030368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 27/50] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:56:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:39.036099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9d27-ac0e-477f-b3de-e365b63e0fd1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:39.150922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9d27-ac0e-477f-b3de-e365b63e0fd1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:39.181341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:39.190508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2991c9-5746-4c80-9b14-492cdeb1c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:39.191152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2991c9-5746-4c80-9b14-492cdeb1c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:39.191432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2991c9-5746-4c80-9b14-492cdeb1c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:39.197843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2991c9-5746-4c80-9b14-492cdeb1c6b2 None admin] PATH_INFO: `/v3/users/05e7d4149924497faf197737573abc5d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:39.197843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2991c9-5746-4c80-9b14-492cdeb1c6b2 None admin] RBAC: Authorizing `identity:get_user(user_id=05e7d4149924497faf197737573abc5d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:39.197843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2991c9-5746-4c80-9b14-492cdeb1c6b2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:39.197843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 24/51] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:39 2022] GET /identity/v3/users/05e7d4149924497faf197737573abc5d => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:39.201762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dfece-d838-4982-b9d2-4eb50d8c179d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:39.332930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dfece-d838-4982-b9d2-4eb50d8c179d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:39.368953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bed7e5-4ca1-4a0f-baf2-9ac4d882c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:39.369934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bed7e5-4ca1-4a0f-baf2-9ac4d882c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:39.370303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bed7e5-4ca1-4a0f-baf2-9ac4d882c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:39.370681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bed7e5-4ca1-4a0f-baf2-9ac4d882c0f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:39.371924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bed7e5-4ca1-4a0f-baf2-9ac4d882c0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:39.373505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bed7e5-4ca1-4a0f-baf2-9ac4d882c0f1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:39.375106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 28/52] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:39.380982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2991c9-5746-4c80-9b14-492cdeb1c6b2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:39.400679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3872d-48d8-4a7b-8ddc-9d1b3eec94f9 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:39.400966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3872d-48d8-4a7b-8ddc-9d1b3eec94f9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:39.401260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3872d-48d8-4a7b-8ddc-9d1b3eec94f9 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:39.402691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 29/53] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:56:39.408778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512a46-4da9-4c6e-bee5-0cb7c628bede None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:39.409063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512a46-4da9-4c6e-bee5-0cb7c628bede None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:39.409347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512a46-4da9-4c6e-bee5-0cb7c628bede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:39.428948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-85512a46-4da9-4c6e-bee5-0cb7c628bede None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:39.430199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-85512a46-4da9-4c6e-bee5-0cb7c628bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:39.443560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:39.496648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2991c9-5746-4c80-9b14-492cdeb1c6b2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:39.505991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 30/54] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:56:39.533786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792bfb-bfb7-49f4-9c47-8e9eccb21bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:39.534415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792bfb-bfb7-49f4-9c47-8e9eccb21bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:39.534698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792bfb-bfb7-49f4-9c47-8e9eccb21bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:39.534974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792bfb-bfb7-49f4-9c47-8e9eccb21bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:39.535706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72792bfb-bfb7-49f4-9c47-8e9eccb21bc7 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.domain.id=default, user.id=05e7d4149924497faf197737573abc5d) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:39.536021 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72792bfb-bfb7-49f4-9c47-8e9eccb21bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:39.537511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72792bfb-bfb7-49f4-9c47-8e9eccb21bc7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:39.546069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 25/55] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Sep 1 11:56:39 2022] GET /identity/v3/role_assignments?user.id=05e7d4149924497faf197737573abc5d&scope.domain.id=default&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:39.771821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512a46-4da9-4c6e-bee5-0cb7c628bede None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:39.866765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512a46-4da9-4c6e-bee5-0cb7c628bede None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:39.900819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d3d69-27e9-4c88-b40b-83a08314ca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:39.901449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3d69-27e9-4c88-b40b-83a08314ca9f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:39.901735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3d69-27e9-4c88-b40b-83a08314ca9f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:39.902015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3d69-27e9-4c88-b40b-83a08314ca9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:39.903123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d3d69-27e9-4c88-b40b-83a08314ca9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:39.904635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d3d69-27e9-4c88-b40b-83a08314ca9f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:39.906212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 31/56] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:39.911923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792bfb-bfb7-49f4-9c47-8e9eccb21bc7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:39.970471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:40.121692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792bfb-bfb7-49f4-9c47-8e9eccb21bc7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:40.157788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ece5f2-4e09-4de7-8e15-7394063b2b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:40.158409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ece5f2-4e09-4de7-8e15-7394063b2b04 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:40.158696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ece5f2-4e09-4de7-8e15-7394063b2b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:40.158978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ece5f2-4e09-4de7-8e15-7394063b2b04 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:40.159641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ece5f2-4e09-4de7-8e15-7394063b2b04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:40.161124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ece5f2-4e09-4de7-8e15-7394063b2b04 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:40.241585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 26/57] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Sep 1 11:56:39 2022] POST /identity/v3/projects => generated 298 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:56:42.150305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16facb82-8fb9-4dbe-8fd5-61753c184f5a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:42.150305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16facb82-8fb9-4dbe-8fd5-61753c184f5a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:42.150879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16facb82-8fb9-4dbe-8fd5-61753c184f5a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:42.151723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 32/58] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:42.159031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894e67-74ff-4cc2-a95c-684ec2fb29d8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:42.159474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894e67-74ff-4cc2-a95c-684ec2fb29d8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:42.159567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894e67-74ff-4cc2-a95c-684ec2fb29d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:42.177443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ef894e67-74ff-4cc2-a95c-684ec2fb29d8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:42.178614 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ef894e67-74ff-4cc2-a95c-684ec2fb29d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:42.243419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 27/59] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:42.511336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16facb82-8fb9-4dbe-8fd5-61753c184f5a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:42.527255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:42.612530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16facb82-8fb9-4dbe-8fd5-61753c184f5a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:42.645962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5cefd-9059-499e-81a7-6dd999749c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:42.646601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5cefd-9059-499e-81a7-6dd999749c48 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:42.646885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5cefd-9059-499e-81a7-6dd999749c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:42.647165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5cefd-9059-499e-81a7-6dd999749c48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:42.648324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5cefd-9059-499e-81a7-6dd999749c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:42.649776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5cefd-9059-499e-81a7-6dd999749c48 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:42.651358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 33/60] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:42.657433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef894e67-74ff-4cc2-a95c-684ec2fb29d8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:42.697673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:42.755063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef894e67-74ff-4cc2-a95c-684ec2fb29d8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:42.789715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efb5b3-57b1-42dd-8eaf-7f0b025b2850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:42.790250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efb5b3-57b1-42dd-8eaf-7f0b025b2850 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:42.790530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efb5b3-57b1-42dd-8eaf-7f0b025b2850 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:42.790805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efb5b3-57b1-42dd-8eaf-7f0b025b2850 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:42.791461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efb5b3-57b1-42dd-8eaf-7f0b025b2850 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:42.792938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efb5b3-57b1-42dd-8eaf-7f0b025b2850 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:42.957967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 28/61] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:56:42 2022] POST /identity/v3/users => generated 275 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:56:46.317993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8c85-643f-4c04-8004-287e0680d43d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:46.319453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8c85-643f-4c04-8004-287e0680d43d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:46.320171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8c85-643f-4c04-8004-287e0680d43d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:46.323342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 34/62] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:46.332576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca6974-4030-4335-939b-4025cda554b6 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:46.334038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca6974-4030-4335-939b-4025cda554b6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:46.334798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca6974-4030-4335-939b-4025cda554b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:46.357074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a2ca6974-4030-4335-939b-4025cda554b6 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:46.358313 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a2ca6974-4030-4335-939b-4025cda554b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:46.445164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 29/63] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:46.630998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81935f8-3504-432d-a57e-dfa211fdf203 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:46.632000 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81935f8-3504-432d-a57e-dfa211fdf203 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:46.632805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81935f8-3504-432d-a57e-dfa211fdf203 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:46.635527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 35/64] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:46.641827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f7be6-0835-44e3-8f25-80f09d712639 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:46.642112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f7be6-0835-44e3-8f25-80f09d712639 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:46.642624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f7be6-0835-44e3-8f25-80f09d712639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:46.671055 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0e0f7be6-0835-44e3-8f25-80f09d712639 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:46.672750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0e0f7be6-0835-44e3-8f25-80f09d712639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:46.700383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:46.774751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 30/65] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:56:46.884113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0de2-6b03-4ec1-ba74-a59f1917120d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:46.885037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0de2-6b03-4ec1-ba74-a59f1917120d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:46.885802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0de2-6b03-4ec1-ba74-a59f1917120d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:46.888969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 36/66] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:46.896946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117c27-a1be-48c1-93ff-f953b286d55a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:46.897304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117c27-a1be-48c1-93ff-f953b286d55a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:46.897568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117c27-a1be-48c1-93ff-f953b286d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:46.921176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-27117c27-a1be-48c1-93ff-f953b286d55a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:46.922398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-27117c27-a1be-48c1-93ff-f953b286d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:47.010633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 31/67] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:56:47.039283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5608-2346-4fe9-b070-d5d7ee9bf2a7 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.039601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117c27-a1be-48c1-93ff-f953b286d55a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:47.040082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5608-2346-4fe9-b070-d5d7ee9bf2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.040714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5608-2346-4fe9-b070-d5d7ee9bf2a7 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.042542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 37/68] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:47.049748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83f76-29e7-458e-b0e0-f25f932ceda0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.050357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83f76-29e7-458e-b0e0-f25f932ceda0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.050838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb83f76-29e7-458e-b0e0-f25f932ceda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.084775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9fb83f76-29e7-458e-b0e0-f25f932ceda0 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:47.086647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9fb83f76-29e7-458e-b0e0-f25f932ceda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:47.164423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:47.180259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 38/69] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:47.181588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb83f76-29e7-458e-b0e0-f25f932ceda0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:47.189405 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117c27-a1be-48c1-93ff-f953b286d55a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:47.228757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:47.258373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04031d3f-9964-402d-a1d6-865053e5c569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:47.259299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04031d3f-9964-402d-a1d6-865053e5c569 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.259726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04031d3f-9964-402d-a1d6-865053e5c569 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.260146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04031d3f-9964-402d-a1d6-865053e5c569 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.285385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04031d3f-9964-402d-a1d6-865053e5c569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-04031d3f-9964-402d-a1d6-865053e5c569 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:47.290612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:47.291624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:56:47.292521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:56:47.294913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 32/70] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:56:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:47.306121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb83f76-29e7-458e-b0e0-f25f932ceda0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:47.307330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04031d3f-9964-402d-a1d6-865053e5c569 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:47.413011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8848749-ac9c-4124-90aa-b2ca5a9e09b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:47.415303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8848749-ac9c-4124-90aa-b2ca5a9e09b3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.416112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8848749-ac9c-4124-90aa-b2ca5a9e09b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.416925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8848749-ac9c-4124-90aa-b2ca5a9e09b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.420375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04031d3f-9964-402d-a1d6-865053e5c569 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:47.437658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8848749-ac9c-4124-90aa-b2ca5a9e09b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b8848749-ac9c-4124-90aa-b2ca5a9e09b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:47.447513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:47.448879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:56:47.450312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:56:47.454915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 39/71] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:47.458192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062169a1-6d51-417a-8846-36ed201e7c45 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.458986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062169a1-6d51-417a-8846-36ed201e7c45 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.459149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c38a5f-fbb2-4955-b4a2-1788098bf60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:47.459698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38a5f-fbb2-4955-b4a2-1788098bf60c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.460199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062169a1-6d51-417a-8846-36ed201e7c45 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.460369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38a5f-fbb2-4955-b4a2-1788098bf60c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.460578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38a5f-fbb2-4955-b4a2-1788098bf60c None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.461549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c38a5f-fbb2-4955-b4a2-1788098bf60c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:47.462004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c38a5f-fbb2-4955-b4a2-1788098bf60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:47.463354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 40/72] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:47.463825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c38a5f-fbb2-4955-b4a2-1788098bf60c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:47.465450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062169a1-6d51-417a-8846-36ed201e7c45 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:47.477983 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 33/73] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:56:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:47.479505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841be4a-ca8d-4b2b-b0cd-ad4a4782f2e2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.479966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841be4a-ca8d-4b2b-b0cd-ad4a4782f2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.480429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841be4a-ca8d-4b2b-b0cd-ad4a4782f2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.508814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f841be4a-ca8d-4b2b-b0cd-ad4a4782f2e2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:47.510913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f841be4a-ca8d-4b2b-b0cd-ad4a4782f2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:47.515113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:47.569319 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:47.603934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062169a1-6d51-417a-8846-36ed201e7c45 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:47.616795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 34/74] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:47.617670 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841be4a-ca8d-4b2b-b0cd-ad4a4782f2e2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:47.657020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8349e-6fde-4e03-b1de-712cd474d9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:47.658160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8349e-6fde-4e03-b1de-712cd474d9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.658770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8349e-6fde-4e03-b1de-712cd474d9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.659116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8349e-6fde-4e03-b1de-712cd474d9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.659847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8349e-6fde-4e03-b1de-712cd474d9d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:47.660326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8349e-6fde-4e03-b1de-712cd474d9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:47.661839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8349e-6fde-4e03-b1de-712cd474d9d7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:47.673155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 41/75] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:56:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:47.674669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8349e-6fde-4e03-b1de-712cd474d9d7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:47.734416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841be4a-ca8d-4b2b-b0cd-ad4a4782f2e2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:47.773732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c985-bf5d-44c3-bcb9-6e9be62a9f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:47.774486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c985-bf5d-44c3-bcb9-6e9be62a9f94 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.774772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c985-bf5d-44c3-bcb9-6e9be62a9f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.775051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c985-bf5d-44c3-bcb9-6e9be62a9f94 None admin] PATH_INFO: `/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.785904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:47.797360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366c985-bf5d-44c3-bcb9-6e9be62a9f94 None admin] RBAC: Authorizing `identity:get_user(user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:47.798871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366c985-bf5d-44c3-bcb9-6e9be62a9f94 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:47.806477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 35/76] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:47 2022] GET /identity/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:47.806477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c985-bf5d-44c3-bcb9-6e9be62a9f94 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:47.816965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8349e-6fde-4e03-b1de-712cd474d9d7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:47.861549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447258e9-a1f3-415a-b05c-9f7925f22611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:47.862750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447258e9-a1f3-415a-b05c-9f7925f22611 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.863327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447258e9-a1f3-415a-b05c-9f7925f22611 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.863707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447258e9-a1f3-415a-b05c-9f7925f22611 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.866617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:47.879007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447258e9-a1f3-415a-b05c-9f7925f22611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-447258e9-a1f3-415a-b05c-9f7925f22611 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:47.884015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:47.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 42/77] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:47.886584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447258e9-a1f3-415a-b05c-9f7925f22611 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:47.934551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c985-bf5d-44c3-bcb9-6e9be62a9f94 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:47.970113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f11d16-4a9f-4cd9-9cf6-c584e490f3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:47.970760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f11d16-4a9f-4cd9-9cf6-c584e490f3ef None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:47.971042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f11d16-4a9f-4cd9-9cf6-c584e490f3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:47.971319 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f11d16-4a9f-4cd9-9cf6-c584e490f3ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:47.982768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f11d16-4a9f-4cd9-9cf6-c584e490f3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-53f11d16-4a9f-4cd9-9cf6-c584e490f3ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:47.987729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:47.989513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 36/78] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:56:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:47.991888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f11d16-4a9f-4cd9-9cf6-c584e490f3ef None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:48.022512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447258e9-a1f3-415a-b05c-9f7925f22611 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:48.061885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:48.063948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8da12-b27e-481b-8003-465f7da7451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:48.065103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8da12-b27e-481b-8003-465f7da7451f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:48.065602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8da12-b27e-481b-8003-465f7da7451f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:48.066121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8da12-b27e-481b-8003-465f7da7451f None admin] PATH_INFO: `/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:48.068255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8da12-b27e-481b-8003-465f7da7451f None admin] RBAC: Authorizing `identity:get_user(user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:48.071095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8da12-b27e-481b-8003-465f7da7451f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:48.080547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 43/79] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:47 2022] GET /identity/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:48.080547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8da12-b27e-481b-8003-465f7da7451f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:48.115366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f11d16-4a9f-4cd9-9cf6-c584e490f3ef None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:48.154474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387c185-a630-4836-8760-7b7e6d1decf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:48.155109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c185-a630-4836-8760-7b7e6d1decf7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:48.155396 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c185-a630-4836-8760-7b7e6d1decf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:48.155678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c185-a630-4836-8760-7b7e6d1decf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:48.186907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:48.235026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387c185-a630-4836-8760-7b7e6d1decf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:48.236191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8da12-b27e-481b-8003-465f7da7451f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:48.236597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387c185-a630-4836-8760-7b7e6d1decf7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:48.292694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bfe88-83c3-4e45-abe7-181fc99aa65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:48.293773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bfe88-83c3-4e45-abe7-181fc99aa65c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:48.294775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bfe88-83c3-4e45-abe7-181fc99aa65c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:48.295241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bfe88-83c3-4e45-abe7-181fc99aa65c None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:48.296085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bfe88-83c3-4e45-abe7-181fc99aa65c None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:48.296443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bfe88-83c3-4e45-abe7-181fc99aa65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:48.297944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bfe88-83c3-4e45-abe7-181fc99aa65c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:48.303145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:48.306873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 44/80] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:56:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:48.307731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bfe88-83c3-4e45-abe7-181fc99aa65c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:48.359102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 37/81] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:56:48.359978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387c185-a630-4836-8760-7b7e6d1decf7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:48.427761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bfe88-83c3-4e45-abe7-181fc99aa65c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:48.453610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:48.464845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2f708-6003-4217-bccd-d5dded8e930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:48.465503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2f708-6003-4217-bccd-d5dded8e930a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:48.465802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2f708-6003-4217-bccd-d5dded8e930a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:48.466593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2f708-6003-4217-bccd-d5dded8e930a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:48.467748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2f708-6003-4217-bccd-d5dded8e930a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:48.469226 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2f708-6003-4217-bccd-d5dded8e930a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:48.470930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 45/82] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:48.471714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2f708-6003-4217-bccd-d5dded8e930a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:48.522055 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387c185-a630-4836-8760-7b7e6d1decf7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:48.571958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ed0e5-8ac6-4aa0-8253-34d0cf696db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:48.573401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ed0e5-8ac6-4aa0-8253-34d0cf696db2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:48.573572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ed0e5-8ac6-4aa0-8253-34d0cf696db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:48.574097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ed0e5-8ac6-4aa0-8253-34d0cf696db2 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:48.575947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ed0e5-8ac6-4aa0-8253-34d0cf696db2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:48.576538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ed0e5-8ac6-4aa0-8253-34d0cf696db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:48.579255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ed0e5-8ac6-4aa0-8253-34d0cf696db2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:48.582630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2f708-6003-4217-bccd-d5dded8e930a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:48.601086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 38/83] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:48.601086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ed0e5-8ac6-4aa0-8253-34d0cf696db2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:48.618991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822db29-cfaf-414d-9da1-57cb01b35398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:48.619622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822db29-cfaf-414d-9da1-57cb01b35398 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:48.619897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822db29-cfaf-414d-9da1-57cb01b35398 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:48.620174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822db29-cfaf-414d-9da1-57cb01b35398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:48.631408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:48.687726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:48.698110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822db29-cfaf-414d-9da1-57cb01b35398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:48.699610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822db29-cfaf-414d-9da1-57cb01b35398 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:48.733969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ed0e5-8ac6-4aa0-8253-34d0cf696db2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:48.776510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edf610-1472-46c8-a6aa-253c2f7ed08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:48.777605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edf610-1472-46c8-a6aa-253c2f7ed08d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:48.778101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edf610-1472-46c8-a6aa-253c2f7ed08d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:48.779141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edf610-1472-46c8-a6aa-253c2f7ed08d None admin] PATH_INFO: `/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:48.781165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edf610-1472-46c8-a6aa-253c2f7ed08d None admin] RBAC: Authorizing `identity:get_user(user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:48.783980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edf610-1472-46c8-a6aa-253c2f7ed08d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:48.787102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 39/84] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:48 2022] GET /identity/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:48.788409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edf610-1472-46c8-a6aa-253c2f7ed08d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:48.822036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 46/85] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:56:48.822881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822db29-cfaf-414d-9da1-57cb01b35398 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:48.890883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:48.912348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edf610-1472-46c8-a6aa-253c2f7ed08d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:48.930534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:48.939912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822db29-cfaf-414d-9da1-57cb01b35398 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:48.951053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16601eb8-64f0-4b99-924a-124c610b769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:48.952133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16601eb8-64f0-4b99-924a-124c610b769c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:48.952688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16601eb8-64f0-4b99-924a-124c610b769c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:48.953196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16601eb8-64f0-4b99-924a-124c610b769c None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:48.955143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16601eb8-64f0-4b99-924a-124c610b769c None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:48.957995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16601eb8-64f0-4b99-924a-124c610b769c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:48.960894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 40/86] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:56:48 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:48.962218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16601eb8-64f0-4b99-924a-124c610b769c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:48.983657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75b9a7-9863-42f1-8aa7-9e0bead09e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:48.984370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b9a7-9863-42f1-8aa7-9e0bead09e16 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:48.984605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b9a7-9863-42f1-8aa7-9e0bead09e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:48.984889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b9a7-9863-42f1-8aa7-9e0bead09e16 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:48.985557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75b9a7-9863-42f1-8aa7-9e0bead09e16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:48.987022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75b9a7-9863-42f1-8aa7-9e0bead09e16 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:49.080244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 47/87] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:56:48 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:56:49.080244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75b9a7-9863-42f1-8aa7-9e0bead09e16 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:49.097360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16601eb8-64f0-4b99-924a-124c610b769c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:49.142963 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6775b-ae21-4098-bf4a-74e6b07aa758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:49.143727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6775b-ae21-4098-bf4a-74e6b07aa758 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:49.144046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6775b-ae21-4098-bf4a-74e6b07aa758 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:49.144455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6775b-ae21-4098-bf4a-74e6b07aa758 None admin] PATH_INFO: `/v3/users/05e7d4149924497faf197737573abc5d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:49.145909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6775b-ae21-4098-bf4a-74e6b07aa758 None admin] RBAC: Authorizing `identity:get_user(user_id=05e7d4149924497faf197737573abc5d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:49.148002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6775b-ae21-4098-bf4a-74e6b07aa758 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:49.151207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 41/88] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:48 2022] GET /identity/v3/users/05e7d4149924497faf197737573abc5d => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:49.152539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6775b-ae21-4098-bf4a-74e6b07aa758 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:49.192797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:49.225351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75b9a7-9863-42f1-8aa7-9e0bead09e16 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:49.281833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683d83d-a7d3-4fdc-9179-57a3d3af1b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:49.282537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683d83d-a7d3-4fdc-9179-57a3d3af1b92 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:49.282859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683d83d-a7d3-4fdc-9179-57a3d3af1b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:49.283145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683d83d-a7d3-4fdc-9179-57a3d3af1b92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:49.308642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:49.315127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6775b-ae21-4098-bf4a-74e6b07aa758 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:49.375637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1744152-7828-4f35-9daf-b5c6516c230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:49.376411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744152-7828-4f35-9daf-b5c6516c230b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:49.376719 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744152-7828-4f35-9daf-b5c6516c230b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:49.376992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744152-7828-4f35-9daf-b5c6516c230b None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:49.378228 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1744152-7828-4f35-9daf-b5c6516c230b None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:49.379860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1744152-7828-4f35-9daf-b5c6516c230b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:49.382549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 42/89] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:56:49 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:49.385319 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683d83d-a7d3-4fdc-9179-57a3d3af1b92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:49.387216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683d83d-a7d3-4fdc-9179-57a3d3af1b92 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:49.388384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1744152-7828-4f35-9daf-b5c6516c230b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:49.521178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:49.530487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 48/90] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:56:49.535683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683d83d-a7d3-4fdc-9179-57a3d3af1b92 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:49.540249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1744152-7828-4f35-9daf-b5c6516c230b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:49.586224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0968-ae28-443c-83ba-e74d94535315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:49.587307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0968-ae28-443c-83ba-e74d94535315 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:49.588622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0968-ae28-443c-83ba-e74d94535315 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:49.589120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0968-ae28-443c-83ba-e74d94535315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:49.590622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0968-ae28-443c-83ba-e74d94535315 None admin] RBAC: Adding query filter params (role.id=c76ef09e05ab4b329ff0580b80c56f59, scope.project.id=960889d116ab4cb4893fa64b6b0869bb, user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:49.591176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0968-ae28-443c-83ba-e74d94535315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:49.593542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e0968-ae28-443c-83ba-e74d94535315 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:49.601440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 43/91] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:56:49 2022] GET /identity/v3/role_assignments?user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=c76ef09e05ab4b329ff0580b80c56f59 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:49.602644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0968-ae28-443c-83ba-e74d94535315 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:49.608636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:49.745137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683d83d-a7d3-4fdc-9179-57a3d3af1b92 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:49.773053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0968-ae28-443c-83ba-e74d94535315 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:49.822206 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c896b-893f-4ff5-bcee-05d4d7e7e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:49.822471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee45c6-e023-4538-a536-a10ddc8fa900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:49.823191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee45c6-e023-4538-a536-a10ddc8fa900 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:49.823552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee45c6-e023-4538-a536-a10ddc8fa900 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:49.823909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee45c6-e023-4538-a536-a10ddc8fa900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:49.824301 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c896b-893f-4ff5-bcee-05d4d7e7e63c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:49.824798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee45c6-e023-4538-a536-a10ddc8fa900 None admin] RBAC: Adding query filter params (role.id=4a2e97979a4c4cd796f797f81fff095a, scope.project.id=960889d116ab4cb4893fa64b6b0869bb, user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:49.825144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee45c6-e023-4538-a536-a10ddc8fa900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:49.825617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c896b-893f-4ff5-bcee-05d4d7e7e63c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:49.826352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c896b-893f-4ff5-bcee-05d4d7e7e63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:49.826664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee45c6-e023-4538-a536-a10ddc8fa900 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:49.835279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 44/92] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:56:49 2022] GET /identity/v3/role_assignments?user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:49.841730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee45c6-e023-4538-a536-a10ddc8fa900 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:49.892616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:50.031226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee45c6-e023-4538-a536-a10ddc8fa900 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:50.125607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501e030-b2f4-4679-b657-8828f1662342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:50.125607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501e030-b2f4-4679-b657-8828f1662342 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:50.125607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501e030-b2f4-4679-b657-8828f1662342 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:50.125607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501e030-b2f4-4679-b657-8828f1662342 None admin] PATH_INFO: `/v3/projects/913e7a47e9a14695a03b8e3292849ad3` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:50.132244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501e030-b2f4-4679-b657-8828f1662342 None admin] RBAC: Authorizing `identity:get_project(project_id=913e7a47e9a14695a03b8e3292849ad3)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:50.132244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501e030-b2f4-4679-b657-8828f1662342 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:50.132244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 45/93] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:56:49 2022] GET /identity/v3/projects/913e7a47e9a14695a03b8e3292849ad3 => generated 312 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:50.138582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501e030-b2f4-4679-b657-8828f1662342 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:50.168419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c896b-893f-4ff5-bcee-05d4d7e7e63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:50.172331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c896b-893f-4ff5-bcee-05d4d7e7e63c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:50.272769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:50.289044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:50.306536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501e030-b2f4-4679-b657-8828f1662342 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:50.327838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 49/94] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:56:50.334510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c896b-893f-4ff5-bcee-05d4d7e7e63c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:50.395934 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1c785-5025-4da7-af73-b2e97b25e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:50.396852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1c785-5025-4da7-af73-b2e97b25e80f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:50.397316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1c785-5025-4da7-af73-b2e97b25e80f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:50.397800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1c785-5025-4da7-af73-b2e97b25e80f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:50.399195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1c785-5025-4da7-af73-b2e97b25e80f None admin] RBAC: Adding query filter params (role.id=4a2e97979a4c4cd796f797f81fff095a, scope.project.id=913e7a47e9a14695a03b8e3292849ad3, user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:50.399736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1c785-5025-4da7-af73-b2e97b25e80f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:50.402525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1c785-5025-4da7-af73-b2e97b25e80f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:50.436348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 46/95] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:56:50 2022] GET /identity/v3/role_assignments?user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2&scope.project.id=913e7a47e9a14695a03b8e3292849ad3&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:50.591478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c896b-893f-4ff5-bcee-05d4d7e7e63c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:50.659147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d63ce-a38e-4120-8ab4-4a41317afefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:50.660128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d63ce-a38e-4120-8ab4-4a41317afefd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:50.660643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d63ce-a38e-4120-8ab4-4a41317afefd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:50.661113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d63ce-a38e-4120-8ab4-4a41317afefd None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:50.663146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d63ce-a38e-4120-8ab4-4a41317afefd None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:50.665835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d63ce-a38e-4120-8ab4-4a41317afefd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:50.669409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 50/96] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:56:50 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:50.677223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1c785-5025-4da7-af73-b2e97b25e80f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:50.817882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1c785-5025-4da7-af73-b2e97b25e80f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:50.861264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af897ed9-4371-424a-a005-c3c0454d95a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:50.861892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af897ed9-4371-424a-a005-c3c0454d95a4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:50.862177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af897ed9-4371-424a-a005-c3c0454d95a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:50.862457 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af897ed9-4371-424a-a005-c3c0454d95a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:50.863199 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af897ed9-4371-424a-a005-c3c0454d95a4 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=960889d116ab4cb4893fa64b6b0869bb, user.id=05e7d4149924497faf197737573abc5d) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:50.863518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af897ed9-4371-424a-a005-c3c0454d95a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:50.865054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af897ed9-4371-424a-a005-c3c0454d95a4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:50.875822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 47/97] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:56:50 2022] GET /identity/v3/role_assignments?user.id=05e7d4149924497faf197737573abc5d&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:52.186796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f0513-65a7-4c24-a6f1-1aba42813362 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:52.187352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f0513-65a7-4c24-a6f1-1aba42813362 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:52.187759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f0513-65a7-4c24-a6f1-1aba42813362 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:52.190220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 51/98] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:52.210281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2a12f-9f24-4782-b44a-bacfcd4700e4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:52.211067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2a12f-9f24-4782-b44a-bacfcd4700e4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:52.211067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2a12f-9f24-4782-b44a-bacfcd4700e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:52.233437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-63f2a12f-9f24-4782-b44a-bacfcd4700e4 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:52.234718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-63f2a12f-9f24-4782-b44a-bacfcd4700e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:52.250356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:52.332891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 48/99] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:52.413797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e53ef-eb2b-4f73-98c6-ef37388452f3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:52.414632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e53ef-eb2b-4f73-98c6-ef37388452f3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:52.415285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e53ef-eb2b-4f73-98c6-ef37388452f3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:52.417490 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 52/100] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:52.423875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaa8ef-05d6-4aa3-97a6-2efcff46540a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:52.424493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaa8ef-05d6-4aa3-97a6-2efcff46540a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:52.425003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaa8ef-05d6-4aa3-97a6-2efcff46540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:52.450865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-26eaa8ef-05d6-4aa3-97a6-2efcff46540a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:52.452523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-26eaa8ef-05d6-4aa3-97a6-2efcff46540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:52.547477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 49/101] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:56:53.170303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e53ef-eb2b-4f73-98c6-ef37388452f3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:53.205622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:53.240177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507302-6eb1-4f9f-b9e7-c3e548c12fe0 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:53.241082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507302-6eb1-4f9f-b9e7-c3e548c12fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:53.241551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507302-6eb1-4f9f-b9e7-c3e548c12fe0 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:53.243219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 50/102] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:53.255561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca68c1-3192-48a1-9e22-f193895e0111 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:53.256180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca68c1-3192-48a1-9e22-f193895e0111 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:53.256515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca68c1-3192-48a1-9e22-f193895e0111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:53.285800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9aca68c1-3192-48a1-9e22-f193895e0111 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:53.287116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9aca68c1-3192-48a1-9e22-f193895e0111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:53.397104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e53ef-eb2b-4f73-98c6-ef37388452f3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:53.431658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 51/103] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:53.432519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca68c1-3192-48a1-9e22-f193895e0111 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:53.444691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:53.481355 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1117e-325a-485d-a115-1193f82b35d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:53.482881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1117e-325a-485d-a115-1193f82b35d6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:53.483656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1117e-325a-485d-a115-1193f82b35d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:53.484722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1117e-325a-485d-a115-1193f82b35d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:53.530576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1117e-325a-485d-a115-1193f82b35d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a8e1117e-325a-485d-a115-1193f82b35d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:53.550256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:53.552324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:56:53.553838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:56:53.558501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 53/104] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:56:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:56:53.567828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1117e-325a-485d-a115-1193f82b35d6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:53.731736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca68c1-3192-48a1-9e22-f193895e0111 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:53.754945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:53.795559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1117e-325a-485d-a115-1193f82b35d6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:53.802205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf794c2-a19e-457c-98db-bd852baafd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:53.802864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf794c2-a19e-457c-98db-bd852baafd99 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:53.803151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf794c2-a19e-457c-98db-bd852baafd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:53.803425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf794c2-a19e-457c-98db-bd852baafd99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:53.815315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf794c2-a19e-457c-98db-bd852baafd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-7bf794c2-a19e-457c-98db-bd852baafd99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:53.820997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:53.822792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 52/105] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:56:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:53.825940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf794c2-a19e-457c-98db-bd852baafd99 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:53.864325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256c643-8e84-49ea-9aaf-610427198c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:53.864973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c643-8e84-49ea-9aaf-610427198c00 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:53.865258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c643-8e84-49ea-9aaf-610427198c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:53.865805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c643-8e84-49ea-9aaf-610427198c00 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:53.867009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256c643-8e84-49ea-9aaf-610427198c00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:53.867324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256c643-8e84-49ea-9aaf-610427198c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:53.869492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256c643-8e84-49ea-9aaf-610427198c00 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:53.884446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 54/106] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:56:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:53.885800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd5d2f-8169-4927-a239-292d09809efe None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:53.886072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd5d2f-8169-4927-a239-292d09809efe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:53.886334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd5d2f-8169-4927-a239-292d09809efe None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:53.888720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 55/107] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:53.889144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd5d2f-8169-4927-a239-292d09809efe None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:53.926601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:53.983946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf794c2-a19e-457c-98db-bd852baafd99 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:54.021613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd5d2f-8169-4927-a239-292d09809efe None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:54.034693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012780f-a104-4ee4-9b60-79d05760b439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:54.035648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012780f-a104-4ee4-9b60-79d05760b439 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:54.035936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012780f-a104-4ee4-9b60-79d05760b439 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:54.036242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012780f-a104-4ee4-9b60-79d05760b439 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:54.037737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012780f-a104-4ee4-9b60-79d05760b439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:54.040112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012780f-a104-4ee4-9b60-79d05760b439 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:54.042080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 53/108] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:54.044947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012780f-a104-4ee4-9b60-79d05760b439 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:54.067975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a333-742c-452a-9069-8886467867e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:54.068718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a333-742c-452a-9069-8886467867e4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:54.069104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a333-742c-452a-9069-8886467867e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:54.069450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a333-742c-452a-9069-8886467867e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:54.070280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407a333-742c-452a-9069-8886467867e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:54.070713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407a333-742c-452a-9069-8886467867e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:54.072326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407a333-742c-452a-9069-8886467867e4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:54.078910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:54.082992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 56/109] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:56:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:54.087639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdab79-f595-4155-bcda-bce98f09eab7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:54.087639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdab79-f595-4155-bcda-bce98f09eab7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:54.087639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdab79-f595-4155-bcda-bce98f09eab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:54.118797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1bfdab79-f595-4155-bcda-bce98f09eab7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:54.118797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1bfdab79-f595-4155-bcda-bce98f09eab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:54.187321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012780f-a104-4ee4-9b60-79d05760b439 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:54.202623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 57/110] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:54.203712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdab79-f595-4155-bcda-bce98f09eab7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:54.253823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:54.267761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268788bd-60fa-4ffc-a46f-71966b549479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:54.273164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268788bd-60fa-4ffc-a46f-71966b549479 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:54.273164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268788bd-60fa-4ffc-a46f-71966b549479 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:54.273164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268788bd-60fa-4ffc-a46f-71966b549479 None admin] PATH_INFO: `/v3/users/571922bf374242abb33c180ec4c10895` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:54.303072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268788bd-60fa-4ffc-a46f-71966b549479 None admin] RBAC: Authorizing `identity:get_user(user_id=571922bf374242abb33c180ec4c10895)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:54.304963 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268788bd-60fa-4ffc-a46f-71966b549479 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:54.306743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 54/111] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:54 2022] GET /identity/v3/users/571922bf374242abb33c180ec4c10895 => generated 289 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:54.307737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268788bd-60fa-4ffc-a46f-71966b549479 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:54.332504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdab79-f595-4155-bcda-bce98f09eab7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:54.368620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:54.375396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d1465-9ead-4524-8522-870abdde4699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:54.376298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d1465-9ead-4524-8522-870abdde4699 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:54.387406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d1465-9ead-4524-8522-870abdde4699 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:54.387406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d1465-9ead-4524-8522-870abdde4699 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:54.387406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d1465-9ead-4524-8522-870abdde4699 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:54.387406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d1465-9ead-4524-8522-870abdde4699 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:54.472891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268788bd-60fa-4ffc-a46f-71966b549479 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:54.483003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 58/112] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:56:54 2022] POST /identity/v3/projects => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:56:54.484343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d1465-9ead-4524-8522-870abdde4699 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:54.544192 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2675c-bd4d-45a2-91c0-15a5b86c3d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:54.545242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2675c-bd4d-45a2-91c0-15a5b86c3d5a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:54.545679 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2675c-bd4d-45a2-91c0-15a5b86c3d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:54.546096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2675c-bd4d-45a2-91c0-15a5b86c3d5a None admin] PATH_INFO: `/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:54.547501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2675c-bd4d-45a2-91c0-15a5b86c3d5a None admin] RBAC: Authorizing `identity:get_user(user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:54.549161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2675c-bd4d-45a2-91c0-15a5b86c3d5a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:54.551316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 55/113] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:54 2022] GET /identity/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:54.557366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2675c-bd4d-45a2-91c0-15a5b86c3d5a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:54.652669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:54.708801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2675c-bd4d-45a2-91c0-15a5b86c3d5a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:54.733873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d1465-9ead-4524-8522-870abdde4699 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:54.752900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af90eb-47ff-40d8-9107-104121f8fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:54.753622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af90eb-47ff-40d8-9107-104121f8fa08 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:54.754033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af90eb-47ff-40d8-9107-104121f8fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:54.754321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af90eb-47ff-40d8-9107-104121f8fa08 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:54.755747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af90eb-47ff-40d8-9107-104121f8fa08 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:54.757378 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af90eb-47ff-40d8-9107-104121f8fa08 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:54.759146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 56/114] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:56:54 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:54.762866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af90eb-47ff-40d8-9107-104121f8fa08 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:54.787797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8bfa5-d2e3-4832-ae43-9d80578b79dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:54.791101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8bfa5-d2e3-4832-ae43-9d80578b79dd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:54.791101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8bfa5-d2e3-4832-ae43-9d80578b79dd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:54.791101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8bfa5-d2e3-4832-ae43-9d80578b79dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:54.881660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:54.911740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8bfa5-d2e3-4832-ae43-9d80578b79dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:54.913272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8bfa5-d2e3-4832-ae43-9d80578b79dd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:54.914752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af90eb-47ff-40d8-9107-104121f8fa08 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:54.965744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:54.983726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4b33d-e794-4699-9335-b153d9882deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:54.984438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4b33d-e794-4699-9335-b153d9882deb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:54.984727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4b33d-e794-4699-9335-b153d9882deb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:54.985010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4b33d-e794-4699-9335-b153d9882deb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:54.999376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4b33d-e794-4699-9335-b153d9882deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e1e4b33d-e794-4699-9335-b153d9882deb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:55.004711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:55.005639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:56:55.006380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:56:55.010867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 57/115] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:56:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:55.013906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe14a1-5630-423a-a97a-bdb6c914b223 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:55.014207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe14a1-5630-423a-a97a-bdb6c914b223 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:55.014493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe14a1-5630-423a-a97a-bdb6c914b223 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:55.015924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 58/116] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:55.017201 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2335a5e-e497-47e0-8278-8cbf2c1e5ff2 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:55.017488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2335a5e-e497-47e0-8278-8cbf2c1e5ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:55.017851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2335a5e-e497-47e0-8278-8cbf2c1e5ff2 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:55.019361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 59/117] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:55.021085 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2335a5e-e497-47e0-8278-8cbf2c1e5ff2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:55.055929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 59/118] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:56:55.062092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8bfa5-d2e3-4832-ae43-9d80578b79dd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:55.154446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2335a5e-e497-47e0-8278-8cbf2c1e5ff2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:55.180248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:55.205763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76e186-3029-4b36-988a-fc5d3a446865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:55.206676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76e186-3029-4b36-988a-fc5d3a446865 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:55.207133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76e186-3029-4b36-988a-fc5d3a446865 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:55.207593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76e186-3029-4b36-988a-fc5d3a446865 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb/users/d06ec2bc25fe49a7b6a30ea0cfc828a2/roles/c76ef09e05ab4b329ff0580b80c56f59` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:55.211225 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76e186-3029-4b36-988a-fc5d3a446865 None admin] RBAC: Authorizing `identity:create_grant(project_id=960889d116ab4cb4893fa64b6b0869bb, user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2, role_id=c76ef09e05ab4b329ff0580b80c56f59)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:55.211732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8bfa5-d2e3-4832-ae43-9d80578b79dd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:55.213833 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76e186-3029-4b36-988a-fc5d3a446865 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:55.256244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df86f9b-c9bf-447b-9fc6-5da9ac255013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:55.256852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df86f9b-c9bf-447b-9fc6-5da9ac255013 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:55.257140 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df86f9b-c9bf-447b-9fc6-5da9ac255013 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:55.257422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df86f9b-c9bf-447b-9fc6-5da9ac255013 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:55.258123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df86f9b-c9bf-447b-9fc6-5da9ac255013 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:55.258441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df86f9b-c9bf-447b-9fc6-5da9ac255013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:55.259947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df86f9b-c9bf-447b-9fc6-5da9ac255013 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:55.270321 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 60/119] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:56:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:55.271506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd23a8-5226-47b8-994a-34986bbe4bac None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:55.271801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd23a8-5226-47b8-994a-34986bbe4bac None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:55.272087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd23a8-5226-47b8-994a-34986bbe4bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:55.290305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 60/120] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:56:55 2022] PUT /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb/users/d06ec2bc25fe49a7b6a30ea0cfc828a2/roles/c76ef09e05ab4b329ff0580b80c56f59 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:56:55.292240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-57cd23a8-5226-47b8-994a-34986bbe4bac None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:55.293785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-57cd23a8-5226-47b8-994a-34986bbe4bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:55.302116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f87a1f-0712-4b17-8185-a7bb1880d563 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:55.302568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f87a1f-0712-4b17-8185-a7bb1880d563 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:55.302988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f87a1f-0712-4b17-8185-a7bb1880d563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:55.339171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-51f87a1f-0712-4b17-8185-a7bb1880d563 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:55.341164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-51f87a1f-0712-4b17-8185-a7bb1880d563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:55.394285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:55.423394 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 61/121] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:55.425326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd23a8-5226-47b8-994a-34986bbe4bac None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:55.429793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 61/122] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:55.430513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f87a1f-0712-4b17-8185-a7bb1880d563 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:55.553337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f87a1f-0712-4b17-8185-a7bb1880d563 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:55.601177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52b46c-57a3-4a08-8c21-973edc553cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:55.601867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52b46c-57a3-4a08-8c21-973edc553cef None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:55.602152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52b46c-57a3-4a08-8c21-973edc553cef None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:55.602428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52b46c-57a3-4a08-8c21-973edc553cef None admin] PATH_INFO: `/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:55.603956 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52b46c-57a3-4a08-8c21-973edc553cef None admin] RBAC: Authorizing `identity:get_user(user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:55.605499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52b46c-57a3-4a08-8c21-973edc553cef None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:55.607322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 62/123] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:55 2022] GET /identity/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:55.620379 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52b46c-57a3-4a08-8c21-973edc553cef None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:55.659663 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:55.714071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd23a8-5226-47b8-994a-34986bbe4bac None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:55.744643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:55.804499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d73a-d4c7-4bd1-8dfd-8f3f6197b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:55.805175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d73a-d4c7-4bd1-8dfd-8f3f6197b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:55.805458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d73a-d4c7-4bd1-8dfd-8f3f6197b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:55.805733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d73a-d4c7-4bd1-8dfd-8f3f6197b8b5 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:55.809267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d73a-d4c7-4bd1-8dfd-8f3f6197b8b5 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:55.810969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d73a-d4c7-4bd1-8dfd-8f3f6197b8b5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:55.813014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 62/124] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:56:55 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:55.823154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d73a-d4c7-4bd1-8dfd-8f3f6197b8b5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:55.835575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52b46c-57a3-4a08-8c21-973edc553cef None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:55.906811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e0db4-64fd-4f40-8430-aa9c7b32f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:55.907483 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0db4-64fd-4f40-8430-aa9c7b32f840 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:55.907772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0db4-64fd-4f40-8430-aa9c7b32f840 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:55.908056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0db4-64fd-4f40-8430-aa9c7b32f840 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:55.910736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e0db4-64fd-4f40-8430-aa9c7b32f840 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:55.913149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e0db4-64fd-4f40-8430-aa9c7b32f840 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:55.916043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 63/125] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:56:55 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:55.925301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e0db4-64fd-4f40-8430-aa9c7b32f840 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:56.113227 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d73a-d4c7-4bd1-8dfd-8f3f6197b8b5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:56.179596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e0db4-64fd-4f40-8430-aa9c7b32f840 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:56.201427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada5859-1087-4058-b6e7-629615c0e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:56.202626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada5859-1087-4058-b6e7-629615c0e27a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:56.203143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada5859-1087-4058-b6e7-629615c0e27a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:56.203623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada5859-1087-4058-b6e7-629615c0e27a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:56.205079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:56.206088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada5859-1087-4058-b6e7-629615c0e27a None admin] RBAC: Adding query filter params (role.id=57523b6804424d1782f8e7df8974669f, scope.project.id=960889d116ab4cb4893fa64b6b0869bb, user.id=571922bf374242abb33c180ec4c10895) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:56.206732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada5859-1087-4058-b6e7-629615c0e27a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:56.209583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada5859-1087-4058-b6e7-629615c0e27a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:56.220104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 63/126] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:56:55 2022] GET /identity/v3/role_assignments?user.id=571922bf374242abb33c180ec4c10895&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=57523b6804424d1782f8e7df8974669f => generated 259 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:56.222142 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada5859-1087-4058-b6e7-629615c0e27a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:56.243294 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:56.249083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8400-8e96-42c5-b750-917ce3978c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:56.250109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8400-8e96-42c5-b750-917ce3978c31 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:56.252685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8400-8e96-42c5-b750-917ce3978c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:56.252974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8400-8e96-42c5-b750-917ce3978c31 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb/users/d06ec2bc25fe49a7b6a30ea0cfc828a2/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:56.255216 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e8400-8e96-42c5-b750-917ce3978c31 None admin] RBAC: Authorizing `identity:create_grant(project_id=960889d116ab4cb4893fa64b6b0869bb, user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:56.256809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e8400-8e96-42c5-b750-917ce3978c31 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:56.393798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 64/127] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:56:55 2022] PUT /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb/users/d06ec2bc25fe49a7b6a30ea0cfc828a2/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 11:56:56.394764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8400-8e96-42c5-b750-917ce3978c31 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:56.451837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada5859-1087-4058-b6e7-629615c0e27a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:56.537793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd852c2-7cf3-40de-930b-8eac02a9e3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:56.538452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd852c2-7cf3-40de-930b-8eac02a9e3fd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:56.538737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd852c2-7cf3-40de-930b-8eac02a9e3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:56.539019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd852c2-7cf3-40de-930b-8eac02a9e3fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:56.562264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd852c2-7cf3-40de-930b-8eac02a9e3fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0cd852c2-7cf3-40de-930b-8eac02a9e3fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:56.568085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:56.571744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:56:56.574820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 64/128] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:56:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:56.582441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd852c2-7cf3-40de-930b-8eac02a9e3fd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:56.596066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8400-8e96-42c5-b750-917ce3978c31 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:56.681122 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:56.740036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd852c2-7cf3-40de-930b-8eac02a9e3fd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:56.757707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bdeb-6fd9-4dc7-9aa8-80b9df8c5eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:56.758909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bdeb-6fd9-4dc7-9aa8-80b9df8c5eea None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:56.759407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bdeb-6fd9-4dc7-9aa8-80b9df8c5eea None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:56.759909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bdeb-6fd9-4dc7-9aa8-80b9df8c5eea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:56.812563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093acd7-25f4-4ae3-a162-1fd35efe0a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:56.813313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093acd7-25f4-4ae3-a162-1fd35efe0a9d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:56.813459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068bdeb-6fd9-4dc7-9aa8-80b9df8c5eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:56:56.813582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093acd7-25f4-4ae3-a162-1fd35efe0a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:56.813869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093acd7-25f4-4ae3-a162-1fd35efe0a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:56.814568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093acd7-25f4-4ae3-a162-1fd35efe0a9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:56.814880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093acd7-25f4-4ae3-a162-1fd35efe0a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:56.816320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093acd7-25f4-4ae3-a162-1fd35efe0a9d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b068bdeb-6fd9-4dc7-9aa8-80b9df8c5eea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:56:56.829907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:56:56.831565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:56:56.833032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 65/129] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:56:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:56:56.834183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 65/130] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:56:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:56.842758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093acd7-25f4-4ae3-a162-1fd35efe0a9d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:56.843066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bdeb-6fd9-4dc7-9aa8-80b9df8c5eea None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:56.948846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:56.983760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093acd7-25f4-4ae3-a162-1fd35efe0a9d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:57.027446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:57.034998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ccebf-4c3c-49fe-a4bc-95aa9d132855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:57.036349 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ccebf-4c3c-49fe-a4bc-95aa9d132855 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:57.036815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ccebf-4c3c-49fe-a4bc-95aa9d132855 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:57.037261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ccebf-4c3c-49fe-a4bc-95aa9d132855 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:57.039316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ccebf-4c3c-49fe-a4bc-95aa9d132855 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:56:57.040494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ccebf-4c3c-49fe-a4bc-95aa9d132855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:57.043471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ccebf-4c3c-49fe-a4bc-95aa9d132855 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:57.063068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 66/131] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:56:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:57.070930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ccebf-4c3c-49fe-a4bc-95aa9d132855 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:57.141947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bdeb-6fd9-4dc7-9aa8-80b9df8c5eea None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:57.193602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ccebf-4c3c-49fe-a4bc-95aa9d132855 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:57.234199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99d3c2-a738-444b-972e-92bbcb7c5212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:57.235264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99d3c2-a738-444b-972e-92bbcb7c5212 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:57.236054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99d3c2-a738-444b-972e-92bbcb7c5212 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:57.236854 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99d3c2-a738-444b-972e-92bbcb7c5212 None admin] PATH_INFO: `/v3/users/05e7d4149924497faf197737573abc5d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:57.238367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99d3c2-a738-444b-972e-92bbcb7c5212 None admin] RBAC: Authorizing `identity:get_user(user_id=05e7d4149924497faf197737573abc5d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:57.240061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99d3c2-a738-444b-972e-92bbcb7c5212 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:57.242661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 67/132] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:57 2022] GET /identity/v3/users/05e7d4149924497faf197737573abc5d => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:57.251994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99d3c2-a738-444b-972e-92bbcb7c5212 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:57.279571 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6a26d-0f6c-4272-8b8c-9fc6164f54cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:57.281162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6a26d-0f6c-4272-8b8c-9fc6164f54cc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:57.281301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6a26d-0f6c-4272-8b8c-9fc6164f54cc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:57.281732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6a26d-0f6c-4272-8b8c-9fc6164f54cc None admin] PATH_INFO: `/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:57.286292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6a26d-0f6c-4272-8b8c-9fc6164f54cc None admin] RBAC: Authorizing `identity:get_user(user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:57.289244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6a26d-0f6c-4272-8b8c-9fc6164f54cc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:57.299529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 66/133] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:56:56 2022] GET /identity/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2 => generated 275 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:57.303136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6a26d-0f6c-4272-8b8c-9fc6164f54cc None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:57.330691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:57.381586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99d3c2-a738-444b-972e-92bbcb7c5212 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:57.425420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd556c5-d5fd-45b5-ae90-fe65c6c60510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:57.426728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd556c5-d5fd-45b5-ae90-fe65c6c60510 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:57.427250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd556c5-d5fd-45b5-ae90-fe65c6c60510 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:57.427734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd556c5-d5fd-45b5-ae90-fe65c6c60510 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:57.429642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd556c5-d5fd-45b5-ae90-fe65c6c60510 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:57.432613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd556c5-d5fd-45b5-ae90-fe65c6c60510 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:57.434860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 68/134] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:56:57 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:56:57.444894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd556c5-d5fd-45b5-ae90-fe65c6c60510 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:57.608699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:57.621292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6a26d-0f6c-4272-8b8c-9fc6164f54cc None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:57.706338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563804a-fcd8-4bcb-9154-50b12eab034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:57.707350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563804a-fcd8-4bcb-9154-50b12eab034b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:57.707820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563804a-fcd8-4bcb-9154-50b12eab034b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:57.708314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563804a-fcd8-4bcb-9154-50b12eab034b None admin] PATH_INFO: `/v3/projects/913e7a47e9a14695a03b8e3292849ad3` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:57.713709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563804a-fcd8-4bcb-9154-50b12eab034b None admin] RBAC: Authorizing `identity:get_project(project_id=913e7a47e9a14695a03b8e3292849ad3)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:57.724253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563804a-fcd8-4bcb-9154-50b12eab034b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:57.724253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 67/135] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:56:57 2022] GET /identity/v3/projects/913e7a47e9a14695a03b8e3292849ad3 => generated 312 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:57.724253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbd3b5-9c76-4565-93f9-3d9b442037ab None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:57.724253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbd3b5-9c76-4565-93f9-3d9b442037ab None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:57.724253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbd3b5-9c76-4565-93f9-3d9b442037ab None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:57.725672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 68/136] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:56:57.734391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbd3b5-9c76-4565-93f9-3d9b442037ab None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:57.776678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd556c5-d5fd-45b5-ae90-fe65c6c60510 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:57.824857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:57.835915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41fff4-619d-468c-96e4-8c8e072cd7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:57.836815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41fff4-619d-468c-96e4-8c8e072cd7e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:57.837104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41fff4-619d-468c-96e4-8c8e072cd7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:57.837537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41fff4-619d-468c-96e4-8c8e072cd7e5 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb/users/05e7d4149924497faf197737573abc5d/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:57.839857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41fff4-619d-468c-96e4-8c8e072cd7e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=960889d116ab4cb4893fa64b6b0869bb, user_id=05e7d4149924497faf197737573abc5d, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:57.842055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41fff4-619d-468c-96e4-8c8e072cd7e5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:57.930612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 69/137] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:56:57 2022] PUT /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb/users/05e7d4149924497faf197737573abc5d/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 11:56:57.932059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a0046-a364-4fef-8290-8421b461fb47 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:57.940967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a0046-a364-4fef-8290-8421b461fb47 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:57.941531 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a0046-a364-4fef-8290-8421b461fb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:57.970532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbd3b5-9c76-4565-93f9-3d9b442037ab None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:58.005986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6b5a0046-a364-4fef-8290-8421b461fb47 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:56:58.007895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6b5a0046-a364-4fef-8290-8421b461fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:56:58.062583 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553e840-88ca-47c0-8438-05d8bcba30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:58.063753 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553e840-88ca-47c0-8438-05d8bcba30b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:58.064279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553e840-88ca-47c0-8438-05d8bcba30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:58.064779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553e840-88ca-47c0-8438-05d8bcba30b0 None admin] PATH_INFO: `/v3/projects/913e7a47e9a14695a03b8e3292849ad3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:58.075391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553e840-88ca-47c0-8438-05d8bcba30b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=913e7a47e9a14695a03b8e3292849ad3, user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:58.078362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553e840-88ca-47c0-8438-05d8bcba30b0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:58.179425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 69/138] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:56:57 2022] PUT /identity/v3/projects/913e7a47e9a14695a03b8e3292849ad3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:56:58.208568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 70/139] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:56:58.992959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553e840-88ca-47c0-8438-05d8bcba30b0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:59.049361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:59.188407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553e840-88ca-47c0-8438-05d8bcba30b0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:59.253350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26389d-fe9f-4eba-9e32-2c3c107c65b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:59.254296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26389d-fe9f-4eba-9e32-2c3c107c65b6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:59.254748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26389d-fe9f-4eba-9e32-2c3c107c65b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:59.255208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26389d-fe9f-4eba-9e32-2c3c107c65b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:59.257227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26389d-fe9f-4eba-9e32-2c3c107c65b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:59.259946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26389d-fe9f-4eba-9e32-2c3c107c65b6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:59.263024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 70/140] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:56:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:56:59.272020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a0046-a364-4fef-8290-8421b461fb47 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:56:59.494613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a0046-a364-4fef-8290-8421b461fb47 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:56:59.534507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:56:59.568879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecf9dc-10fc-46db-b139-3995a29b174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:56:59.569949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecf9dc-10fc-46db-b139-3995a29b174f None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:59.570450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecf9dc-10fc-46db-b139-3995a29b174f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:59.570930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecf9dc-10fc-46db-b139-3995a29b174f None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:59.572287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecf9dc-10fc-46db-b139-3995a29b174f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:56:59.575099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecf9dc-10fc-46db-b139-3995a29b174f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:56:59.712029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 71/141] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:56:59 2022] POST /identity/v3/users => generated 283 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:56:59.992841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4123b5c-88f6-4800-8950-0017c07cf9a5 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:56:59.993339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4123b5c-88f6-4800-8950-0017c07cf9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:56:59.993870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4123b5c-88f6-4800-8950-0017c07cf9a5 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:56:59.996230 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 71/142] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:56:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:00.005529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad01a-7430-4e6c-929a-7ba2d58ce945 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:00.006014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad01a-7430-4e6c-929a-7ba2d58ce945 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:00.006484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad01a-7430-4e6c-929a-7ba2d58ce945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:00.044232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f5aad01a-7430-4e6c-929a-7ba2d58ce945 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:00.046121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f5aad01a-7430-4e6c-929a-7ba2d58ce945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:00.081130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b5aba-faa3-41ad-9f4a-1accb412869a None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:00.081593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b5aba-faa3-41ad-9f4a-1accb412869a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:00.082048 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b5aba-faa3-41ad-9f4a-1accb412869a None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:00.084474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 72/143] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:00.094453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e70b7-d3d6-4cc1-9db8-546b802c8966 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:00.095258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e70b7-d3d6-4cc1-9db8-546b802c8966 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:00.095725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e70b7-d3d6-4cc1-9db8-546b802c8966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:00.153954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-744e70b7-d3d6-4cc1-9db8-546b802c8966 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:00.155211 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-744e70b7-d3d6-4cc1-9db8-546b802c8966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:00.205993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 72/144] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:00.312092 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 73/145] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:00.466869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188930d-d560-491e-8733-55ba91c54f3f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:00.467415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188930d-d560-491e-8733-55ba91c54f3f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:00.467655 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188930d-d560-491e-8733-55ba91c54f3f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:00.469796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 73/146] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:00.492261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed8579-e5df-46d8-abbd-fc788f8e8da1 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:00.492261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed8579-e5df-46d8-abbd-fc788f8e8da1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:00.492261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed8579-e5df-46d8-abbd-fc788f8e8da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:00.521503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d5ed8579-e5df-46d8-abbd-fc788f8e8da1 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:00.522794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d5ed8579-e5df-46d8-abbd-fc788f8e8da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:00.566251 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:00.705795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 74/147] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:00.825956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188930d-d560-491e-8733-55ba91c54f3f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:01.059134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188930d-d560-491e-8733-55ba91c54f3f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:01.062079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:01.150662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b95cc7-1bdf-4c5b-9696-5ca088ee0b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:01.151746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95cc7-1bdf-4c5b-9696-5ca088ee0b54 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:01.152191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95cc7-1bdf-4c5b-9696-5ca088ee0b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:01.152773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95cc7-1bdf-4c5b-9696-5ca088ee0b54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:01.185745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b95cc7-1bdf-4c5b-9696-5ca088ee0b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-69b95cc7-1bdf-4c5b-9696-5ca088ee0b54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:01.194636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:01.196352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:01.197838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:01.200921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 74/148] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:01.218131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed8579-e5df-46d8-abbd-fc788f8e8da1 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:01.251896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b95cc7-1bdf-4c5b-9696-5ca088ee0b54 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:01.539354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b95cc7-1bdf-4c5b-9696-5ca088ee0b54 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:01.568071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed8579-e5df-46d8-abbd-fc788f8e8da1 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:01.657566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eca09-51e7-4610-86f1-73c8bbbe9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:01.658291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eca09-51e7-4610-86f1-73c8bbbe9a09 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:01.658576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eca09-51e7-4610-86f1-73c8bbbe9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:01.658851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eca09-51e7-4610-86f1-73c8bbbe9a09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:01.663383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddf83c-f39f-4b55-8864-66151906834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:01.666260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddf83c-f39f-4b55-8864-66151906834a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:01.666541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddf83c-f39f-4b55-8864-66151906834a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:01.666817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddf83c-f39f-4b55-8864-66151906834a None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:01.667511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddf83c-f39f-4b55-8864-66151906834a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:01.667819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddf83c-f39f-4b55-8864-66151906834a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:01.670151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddf83c-f39f-4b55-8864-66151906834a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:01.684061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eca09-51e7-4610-86f1-73c8bbbe9a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:01.691721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 75/149] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:01.691721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddf83c-f39f-4b55-8864-66151906834a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b36eca09-51e7-4610-86f1-73c8bbbe9a09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:01.692605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:01.694145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:01.695653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 75/150] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:01.699736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eca09-51e7-4610-86f1-73c8bbbe9a09 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:01.735454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:01.755247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:01.839751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddf83c-f39f-4b55-8864-66151906834a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:01.892715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c50e5-17c3-42b9-8399-ecfab4f80f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:01.893769 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c50e5-17c3-42b9-8399-ecfab4f80f76 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:01.894251 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c50e5-17c3-42b9-8399-ecfab4f80f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:01.894740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c50e5-17c3-42b9-8399-ecfab4f80f76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:01.917682 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c50e5-17c3-42b9-8399-ecfab4f80f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b21c50e5-17c3-42b9-8399-ecfab4f80f76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:01.928238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:01.929143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:01.930073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:01.932704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 76/151] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:01.934587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c50e5-17c3-42b9-8399-ecfab4f80f76 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:01.984780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eca09-51e7-4610-86f1-73c8bbbe9a09 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:02.052950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:02.073400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c50e5-17c3-42b9-8399-ecfab4f80f76 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:02.091172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc22c08-c277-4f2b-bd46-d658d42e9319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:02.092653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc22c08-c277-4f2b-bd46-d658d42e9319 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:02.093325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc22c08-c277-4f2b-bd46-d658d42e9319 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:02.094011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc22c08-c277-4f2b-bd46-d658d42e9319 None admin] PATH_INFO: `/v3/users/571922bf374242abb33c180ec4c10895` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:02.101624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc22c08-c277-4f2b-bd46-d658d42e9319 None admin] RBAC: Authorizing `identity:get_user(user_id=571922bf374242abb33c180ec4c10895)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:02.104779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc22c08-c277-4f2b-bd46-d658d42e9319 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:02.108784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 76/152] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:01 2022] GET /identity/v3/users/571922bf374242abb33c180ec4c10895 => generated 289 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:02.110645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc22c08-c277-4f2b-bd46-d658d42e9319 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:02.117405 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b2dff-1a64-469c-90a0-1e9885bb9a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:02.118128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b2dff-1a64-469c-90a0-1e9885bb9a3d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:02.118607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b2dff-1a64-469c-90a0-1e9885bb9a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:02.119081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b2dff-1a64-469c-90a0-1e9885bb9a3d None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:02.119955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b2dff-1a64-469c-90a0-1e9885bb9a3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:02.124675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b2dff-1a64-469c-90a0-1e9885bb9a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:02.126444 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b2dff-1a64-469c-90a0-1e9885bb9a3d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:02.135944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 77/153] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:02.137193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b2dff-1a64-469c-90a0-1e9885bb9a3d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:02.249890 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b2dff-1a64-469c-90a0-1e9885bb9a3d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:02.290421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc16d87-c374-407f-8218-9cb9054d874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:02.291418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16d87-c374-407f-8218-9cb9054d874f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:02.291887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16d87-c374-407f-8218-9cb9054d874f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:02.292394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16d87-c374-407f-8218-9cb9054d874f None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:02.294382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc16d87-c374-407f-8218-9cb9054d874f None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:02.296056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc16d87-c374-407f-8218-9cb9054d874f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:02.298173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 78/154] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:02 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:02.299254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc16d87-c374-407f-8218-9cb9054d874f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:02.320901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:02.397639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:02.416672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc16d87-c374-407f-8218-9cb9054d874f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:02.421164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc22c08-c277-4f2b-bd46-d658d42e9319 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:02.459603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70ffd-1603-4075-bda6-132e1cf05686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:02.460694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70ffd-1603-4075-bda6-132e1cf05686 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:02.461232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70ffd-1603-4075-bda6-132e1cf05686 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:02.461706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70ffd-1603-4075-bda6-132e1cf05686 None admin] PATH_INFO: `/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:02.463137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e70ffd-1603-4075-bda6-132e1cf05686 None admin] RBAC: Authorizing `identity:get_user(user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:02.464928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e70ffd-1603-4075-bda6-132e1cf05686 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:02.467098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 79/155] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:02 2022] GET /identity/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:02.468234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70ffd-1603-4075-bda6-132e1cf05686 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:02.537465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9c61-9a08-47bb-8e03-0c3b902b85d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:02.538522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9c61-9a08-47bb-8e03-0c3b902b85d0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:02.539008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9c61-9a08-47bb-8e03-0c3b902b85d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:02.539496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9c61-9a08-47bb-8e03-0c3b902b85d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:02.540817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea9c61-9a08-47bb-8e03-0c3b902b85d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:02.541330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea9c61-9a08-47bb-8e03-0c3b902b85d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:02.548265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea9c61-9a08-47bb-8e03-0c3b902b85d0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:02.570311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 77/156] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:02.581280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9c61-9a08-47bb-8e03-0c3b902b85d0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:02.608822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:02.628503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70ffd-1603-4075-bda6-132e1cf05686 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:02.735409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a644849-3539-45c9-8c85-4854b10f0e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:02.736106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a644849-3539-45c9-8c85-4854b10f0e57 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:02.736554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a644849-3539-45c9-8c85-4854b10f0e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:02.736813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a644849-3539-45c9-8c85-4854b10f0e57 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb/users/571922bf374242abb33c180ec4c10895/roles/57523b6804424d1782f8e7df8974669f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:02.738952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a644849-3539-45c9-8c85-4854b10f0e57 None admin] RBAC: Authorizing `identity:create_grant(project_id=960889d116ab4cb4893fa64b6b0869bb, user_id=571922bf374242abb33c180ec4c10895, role_id=57523b6804424d1782f8e7df8974669f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:02.740464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a644849-3539-45c9-8c85-4854b10f0e57 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:02.872748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 80/157] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:57:02 2022] PUT /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb/users/571922bf374242abb33c180ec4c10895/roles/57523b6804424d1782f8e7df8974669f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:57:02.874254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a644849-3539-45c9-8c85-4854b10f0e57 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:02.887443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9c61-9a08-47bb-8e03-0c3b902b85d0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:02.999110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3803a-cf43-4a50-8e54-bc23bf0e7ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:03.000084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3803a-cf43-4a50-8e54-bc23bf0e7ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:03.000612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3803a-cf43-4a50-8e54-bc23bf0e7ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:03.001113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3803a-cf43-4a50-8e54-bc23bf0e7ae6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:03.067348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a644849-3539-45c9-8c85-4854b10f0e57 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:03.081506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:03.130663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a34aa-20b5-457a-a8ee-82b667a76386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:03.131693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a34aa-20b5-457a-a8ee-82b667a76386 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:03.132174 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a34aa-20b5-457a-a8ee-82b667a76386 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:03.132670 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a34aa-20b5-457a-a8ee-82b667a76386 None admin] PATH_INFO: `/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:03.136521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a34aa-20b5-457a-a8ee-82b667a76386 None admin] RBAC: Authorizing `identity:get_user(user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:03.138860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a34aa-20b5-457a-a8ee-82b667a76386 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:03.140836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 81/158] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:02 2022] GET /identity/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:03.142298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1167c9-b7e0-43ba-a1be-19be31dd8735 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:03.142785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1167c9-b7e0-43ba-a1be-19be31dd8735 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:03.143276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1167c9-b7e0-43ba-a1be-19be31dd8735 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:03.144926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 82/159] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:03.150574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4a78e-6ca2-4d0a-b09d-817ad5cc0eb6 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:03.151177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4a78e-6ca2-4d0a-b09d-817ad5cc0eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:03.151652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4a78e-6ca2-4d0a-b09d-817ad5cc0eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:03.162681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:03.184891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-eda4a78e-6ca2-4d0a-b09d-817ad5cc0eb6 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:03.186516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-eda4a78e-6ca2-4d0a-b09d-817ad5cc0eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:03.244129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3803a-cf43-4a50-8e54-bc23bf0e7ae6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:03.247292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3803a-cf43-4a50-8e54-bc23bf0e7ae6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:03.303134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 83/160] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:03.304941 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4a78e-6ca2-4d0a-b09d-817ad5cc0eb6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:03.494504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4a78e-6ca2-4d0a-b09d-817ad5cc0eb6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:03.570452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6c97f-4da7-46dc-a730-19018dc75f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:03.571975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6c97f-4da7-46dc-a730-19018dc75f69 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:03.572771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6c97f-4da7-46dc-a730-19018dc75f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:03.573525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6c97f-4da7-46dc-a730-19018dc75f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:03.581160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 78/161] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1010 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:03.585937 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:03.590784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3803a-cf43-4a50-8e54-bc23bf0e7ae6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:03.760555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6c97f-4da7-46dc-a730-19018dc75f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:03.764033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6c97f-4da7-46dc-a730-19018dc75f69 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:03.775580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:03.918895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3803a-cf43-4a50-8e54-bc23bf0e7ae6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:04.033444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cecb92-922c-4a36-babf-1ef73685a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:04.034566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cecb92-922c-4a36-babf-1ef73685a789 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:04.035080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cecb92-922c-4a36-babf-1ef73685a789 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:04.035582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cecb92-922c-4a36-babf-1ef73685a789 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:04.037729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cecb92-922c-4a36-babf-1ef73685a789 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:04.039819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 84/162] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:04.042184 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cecb92-922c-4a36-babf-1ef73685a789 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:04.052419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 79/163] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:03 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:04.055089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6c97f-4da7-46dc-a730-19018dc75f69 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:04.055826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cecb92-922c-4a36-babf-1ef73685a789 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:04.156942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:04.322119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6c97f-4da7-46dc-a730-19018dc75f69 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:04.362244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cecb92-922c-4a36-babf-1ef73685a789 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:04.404782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:04.443648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c90a72-bd3a-409b-a360-7202bd787110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:04.444727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c90a72-bd3a-409b-a360-7202bd787110 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:04.445233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c90a72-bd3a-409b-a360-7202bd787110 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:04.445711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c90a72-bd3a-409b-a360-7202bd787110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:04.446720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c90a72-bd3a-409b-a360-7202bd787110 None admin] RBAC: Adding query filter params (role.id=c76ef09e05ab4b329ff0580b80c56f59, scope.project.id=960889d116ab4cb4893fa64b6b0869bb, user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:04.447354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c90a72-bd3a-409b-a360-7202bd787110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:04.449245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c90a72-bd3a-409b-a360-7202bd787110 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:04.462133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 80/164] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:04 2022] GET /identity/v3/role_assignments?user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=c76ef09e05ab4b329ff0580b80c56f59 => generated 608 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:04.463655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8614db8-38f1-4251-9ad0-4223e568fc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:04.464106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b4bd0-b8fa-4110-bbe0-fc2a5048c115 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:04.464622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b4bd0-b8fa-4110-bbe0-fc2a5048c115 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:04.464796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8614db8-38f1-4251-9ad0-4223e568fc61 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:04.465300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8614db8-38f1-4251-9ad0-4223e568fc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:04.465540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b4bd0-b8fa-4110-bbe0-fc2a5048c115 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:04.465796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8614db8-38f1-4251-9ad0-4223e568fc61 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:04.467727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 81/165] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:04.468808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b4bd0-b8fa-4110-bbe0-fc2a5048c115 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:04.476258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8614db8-38f1-4251-9ad0-4223e568fc61 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:04.476258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8614db8-38f1-4251-9ad0-4223e568fc61 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:04.485029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 85/166] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:04 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:04.495272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ee9c9-4db4-4b38-a1e0-fd5e4c18b089 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:04.495791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ee9c9-4db4-4b38-a1e0-fd5e4c18b089 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:04.504493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ee9c9-4db4-4b38-a1e0-fd5e4c18b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:04.566166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1d2ee9c9-4db4-4b38-a1e0-fd5e4c18b089 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:04.568320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1d2ee9c9-4db4-4b38-a1e0-fd5e4c18b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:04.743262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b4bd0-b8fa-4110-bbe0-fc2a5048c115 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:04.768507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 86/167] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:04.769762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ee9c9-4db4-4b38-a1e0-fd5e4c18b089 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:04.831025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647f4cb-e379-4d09-8632-b027087c6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:04.832878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647f4cb-e379-4d09-8632-b027087c6c8b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:04.836449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647f4cb-e379-4d09-8632-b027087c6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:04.836995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647f4cb-e379-4d09-8632-b027087c6c8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:04.871994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647f4cb-e379-4d09-8632-b027087c6c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:04.873916 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e647f4cb-e379-4d09-8632-b027087c6c8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:04.892573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:04.894107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:04.895022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 82/168] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:04.905599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647f4cb-e379-4d09-8632-b027087c6c8b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:05.022830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:05.056240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ee9c9-4db4-4b38-a1e0-fd5e4c18b089 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:05.152030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479bd94-1173-4c7b-9429-12f401afa53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:05.153173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479bd94-1173-4c7b-9429-12f401afa53c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:05.153666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479bd94-1173-4c7b-9429-12f401afa53c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:05.154163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479bd94-1173-4c7b-9429-12f401afa53c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:05.155188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479bd94-1173-4c7b-9429-12f401afa53c None admin] RBAC: Adding query filter params (role.id=4a2e97979a4c4cd796f797f81fff095a, scope.project.id=960889d116ab4cb4893fa64b6b0869bb, user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:05.155713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479bd94-1173-4c7b-9429-12f401afa53c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:05.157481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479bd94-1173-4c7b-9429-12f401afa53c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:05.170486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 87/169] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:04 2022] GET /identity/v3/role_assignments?user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 608 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:05.186661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647f4cb-e379-4d09-8632-b027087c6c8b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:05.241078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca70ab9-3585-46f0-9e97-71ecf7383740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:05.242095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70ab9-3585-46f0-9e97-71ecf7383740 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:05.242614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70ab9-3585-46f0-9e97-71ecf7383740 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:05.243114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70ab9-3585-46f0-9e97-71ecf7383740 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:05.244046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca70ab9-3585-46f0-9e97-71ecf7383740 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:05.244609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca70ab9-3585-46f0-9e97-71ecf7383740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:05.246974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca70ab9-3585-46f0-9e97-71ecf7383740 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:05.261052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 83/170] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:05.269387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479bd94-1173-4c7b-9429-12f401afa53c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:05.393425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:05.402305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479bd94-1173-4c7b-9429-12f401afa53c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:05.446585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd583ce-bd5c-484e-ac23-9bef67a65485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:05.447270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd583ce-bd5c-484e-ac23-9bef67a65485 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:05.447553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd583ce-bd5c-484e-ac23-9bef67a65485 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:05.447831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd583ce-bd5c-484e-ac23-9bef67a65485 None admin] PATH_INFO: `/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:05.449195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd583ce-bd5c-484e-ac23-9bef67a65485 None admin] RBAC: Authorizing `identity:get_user(user_id=d06ec2bc25fe49a7b6a30ea0cfc828a2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:05.451392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd583ce-bd5c-484e-ac23-9bef67a65485 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:05.456622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 88/171] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:05 2022] GET /identity/v3/users/d06ec2bc25fe49a7b6a30ea0cfc828a2 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:05.467230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca70ab9-3585-46f0-9e97-71ecf7383740 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:05.608583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca70ab9-3585-46f0-9e97-71ecf7383740 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:05.617468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:05.657356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd665f-885e-44a0-9e72-c39ceb1b43c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:05.657909 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd665f-885e-44a0-9e72-c39ceb1b43c3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:05.658252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd665f-885e-44a0-9e72-c39ceb1b43c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:05.658717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd665f-885e-44a0-9e72-c39ceb1b43c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:05.777070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd665f-885e-44a0-9e72-c39ceb1b43c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:05.779277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd665f-885e-44a0-9e72-c39ceb1b43c3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:05.883268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd583ce-bd5c-484e-ac23-9bef67a65485 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:05.962998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 84/172] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:05.971729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd665f-885e-44a0-9e72-c39ceb1b43c3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:05.985968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:06.195183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd583ce-bd5c-484e-ac23-9bef67a65485 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:06.254708 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd665f-885e-44a0-9e72-c39ceb1b43c3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:06.304007 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bf7d8-839e-46d9-aeeb-f317fd871e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:06.305447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bf7d8-839e-46d9-aeeb-f317fd871e93 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:06.306149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bf7d8-839e-46d9-aeeb-f317fd871e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:06.306916 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bf7d8-839e-46d9-aeeb-f317fd871e93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:06.341317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064652f-995a-4cd3-af78-37d0dc55907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:06.341759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064652f-995a-4cd3-af78-37d0dc55907c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:06.341995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064652f-995a-4cd3-af78-37d0dc55907c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:06.342253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064652f-995a-4cd3-af78-37d0dc55907c None admin] PATH_INFO: `/v3/projects/913e7a47e9a14695a03b8e3292849ad3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:06.343385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bf7d8-839e-46d9-aeeb-f317fd871e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e77bf7d8-839e-46d9-aeeb-f317fd871e93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:06.348896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:06.350578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:06.352728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 89/173] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:57:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:06.354002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064652f-995a-4cd3-af78-37d0dc55907c None admin] RBAC: Authorizing `identity:get_project(project_id=913e7a47e9a14695a03b8e3292849ad3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:06.354002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064652f-995a-4cd3-af78-37d0dc55907c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:06.355111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 85/174] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:05 2022] GET /identity/v3/projects/913e7a47e9a14695a03b8e3292849ad3 => generated 312 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:06.363253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064652f-995a-4cd3-af78-37d0dc55907c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:06.363461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44abd6-cc46-4d8b-a95f-32dafae0a557 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:06.363461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44abd6-cc46-4d8b-a95f-32dafae0a557 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:06.363461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44abd6-cc46-4d8b-a95f-32dafae0a557 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:06.366152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 90/175] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:06 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:06.367578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44abd6-cc46-4d8b-a95f-32dafae0a557 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:06.414751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:06.552715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:06.556770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44abd6-cc46-4d8b-a95f-32dafae0a557 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:06.601413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0d7a6-1a2e-40c0-b1af-9041f05024cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:06.602044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0d7a6-1a2e-40c0-b1af-9041f05024cf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:06.602316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0d7a6-1a2e-40c0-b1af-9041f05024cf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:06.602592 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0d7a6-1a2e-40c0-b1af-9041f05024cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:06.603355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0d7a6-1a2e-40c0-b1af-9041f05024cf None admin] RBAC: Adding query filter params (role.id=4a2e97979a4c4cd796f797f81fff095a, scope.project.id=913e7a47e9a14695a03b8e3292849ad3, user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:06.603666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0d7a6-1a2e-40c0-b1af-9041f05024cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:06.605204 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0d7a6-1a2e-40c0-b1af-9041f05024cf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:06.612844 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 91/176] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:06 2022] GET /identity/v3/role_assignments?user.id=d06ec2bc25fe49a7b6a30ea0cfc828a2&scope.project.id=913e7a47e9a14695a03b8e3292849ad3&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:06.614249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84c92f-3925-4e4e-9e66-b7af75c5122e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:06.614542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84c92f-3925-4e4e-9e66-b7af75c5122e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:06.614814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84c92f-3925-4e4e-9e66-b7af75c5122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:06.617253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064652f-995a-4cd3-af78-37d0dc55907c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:06.661164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bc84c92f-3925-4e4e-9e66-b7af75c5122e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:06.663804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bc84c92f-3925-4e4e-9e66-b7af75c5122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:06.770790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb663c2-2a33-4e88-8f18-3bac1a969cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:06.770790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb663c2-2a33-4e88-8f18-3bac1a969cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:06.771143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb663c2-2a33-4e88-8f18-3bac1a969cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:06.771408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb663c2-2a33-4e88-8f18-3bac1a969cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:06.772081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb663c2-2a33-4e88-8f18-3bac1a969cc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:06.772420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb663c2-2a33-4e88-8f18-3bac1a969cc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:06.773956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb663c2-2a33-4e88-8f18-3bac1a969cc8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:06.796491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 86/177] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:06.797980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686c91d-1f1e-49aa-ad01-5361d2dc056c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:06.800354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686c91d-1f1e-49aa-ad01-5361d2dc056c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:06.800648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686c91d-1f1e-49aa-ad01-5361d2dc056c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:06.802557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 87/178] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:06.803474 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686c91d-1f1e-49aa-ad01-5361d2dc056c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:06.833582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 92/179] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:06.835118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211da8-c44e-4dd1-9dd5-091e8a235be4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:06.835407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211da8-c44e-4dd1-9dd5-091e8a235be4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:06.835686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211da8-c44e-4dd1-9dd5-091e8a235be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:06.863645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4d211da8-c44e-4dd1-9dd5-091e8a235be4 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:06.865790 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4d211da8-c44e-4dd1-9dd5-091e8a235be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:06.894954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:06.949022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686c91d-1f1e-49aa-ad01-5361d2dc056c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:06.984192 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 93/180] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:06.990315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be821-add2-47cc-a5ba-ea6dbc147c6a None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:06.990601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be821-add2-47cc-a5ba-ea6dbc147c6a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:06.991401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be821-add2-47cc-a5ba-ea6dbc147c6a None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:06.992777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 94/181] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:06.998526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ee280-1393-4787-8f91-909a3eb7a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:06.999242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ee280-1393-4787-8f91-909a3eb7a135 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:06.999518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ee280-1393-4787-8f91-909a3eb7a135 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:06.999790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ee280-1393-4787-8f91-909a3eb7a135 None admin] PATH_INFO: `/v3/users/05e7d4149924497faf197737573abc5d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:07.003510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac22794-f3ac-497d-b9a3-42890294c403 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:07.003848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac22794-f3ac-497d-b9a3-42890294c403 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:07.004127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac22794-f3ac-497d-b9a3-42890294c403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:07.005841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ee280-1393-4787-8f91-909a3eb7a135 None admin] RBAC: Authorizing `identity:get_user(user_id=05e7d4149924497faf197737573abc5d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:07.007544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ee280-1393-4787-8f91-909a3eb7a135 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:07.012552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 88/182] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:06 2022] GET /identity/v3/users/05e7d4149924497faf197737573abc5d => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:07.020702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ee280-1393-4787-8f91-909a3eb7a135 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:07.027964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:07.045329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5ac22794-f3ac-497d-b9a3-42890294c403 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:07.046563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5ac22794-f3ac-497d-b9a3-42890294c403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:07.173186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 95/183] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:07.174114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac22794-f3ac-497d-b9a3-42890294c403 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:07.202993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ee280-1393-4787-8f91-909a3eb7a135 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:07.305911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:07.320985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073a864-1035-4467-bb84-bd367456cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:07.321676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073a864-1035-4467-bb84-bd367456cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:07.322060 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073a864-1035-4467-bb84-bd367456cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:07.326549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073a864-1035-4467-bb84-bd367456cdc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:07.335159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac22794-f3ac-497d-b9a3-42890294c403 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:07.379613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc81d5-bd39-4550-a0d4-34a8ae0b9241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:07.383499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc81d5-bd39-4550-a0d4-34a8ae0b9241 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:07.384031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc81d5-bd39-4550-a0d4-34a8ae0b9241 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:07.384577 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc81d5-bd39-4550-a0d4-34a8ae0b9241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:07.398142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc81d5-bd39-4550-a0d4-34a8ae0b9241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-3cdc81d5-bd39-4550-a0d4-34a8ae0b9241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:07.404019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:07.405270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:07.406080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 96/184] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:57:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:07.406742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc81d5-bd39-4550-a0d4-34a8ae0b9241 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:07.455153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073a864-1035-4467-bb84-bd367456cdc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:07.457019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073a864-1035-4467-bb84-bd367456cdc4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:07.460373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:07.519338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc81d5-bd39-4550-a0d4-34a8ae0b9241 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:07.562181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40f6ba-b138-493f-8ffe-add7b2f3447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:07.562826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f6ba-b138-493f-8ffe-add7b2f3447c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:07.563100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f6ba-b138-493f-8ffe-add7b2f3447c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:07.563372 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f6ba-b138-493f-8ffe-add7b2f3447c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:07.564604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40f6ba-b138-493f-8ffe-add7b2f3447c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:07.566125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40f6ba-b138-493f-8ffe-add7b2f3447c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:07.567867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 97/185] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:57:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:07.567867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40f6ba-b138-493f-8ffe-add7b2f3447c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:07.584171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 89/186] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 11:57:07.585300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:07.585675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9090fb-1397-4939-917d-a3726acec66c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:07.585980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9090fb-1397-4939-917d-a3726acec66c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:07.586265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9090fb-1397-4939-917d-a3726acec66c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:07.587694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 90/187] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:07.588542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9090fb-1397-4939-917d-a3726acec66c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:07.712158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40f6ba-b138-493f-8ffe-add7b2f3447c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:07.724562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9090fb-1397-4939-917d-a3726acec66c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:07.727385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:07.760549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ae362-dbfd-4c3c-94c8-840172b82306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:07.761304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ae362-dbfd-4c3c-94c8-840172b82306 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:07.761472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ae362-dbfd-4c3c-94c8-840172b82306 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:07.761743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ae362-dbfd-4c3c-94c8-840172b82306 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:07.762547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ae362-dbfd-4c3c-94c8-840172b82306 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:07.762849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ae362-dbfd-4c3c-94c8-840172b82306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:07.764280 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ae362-dbfd-4c3c-94c8-840172b82306 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:07.770076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321dafe-99e2-4e1c-bc33-ed63fd705250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:07.771035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321dafe-99e2-4e1c-bc33-ed63fd705250 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:07.771465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321dafe-99e2-4e1c-bc33-ed63fd705250 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:07.771886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321dafe-99e2-4e1c-bc33-ed63fd705250 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:07.783742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 98/188] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:07.783742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ae362-dbfd-4c3c-94c8-840172b82306 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:07.791500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321dafe-99e2-4e1c-bc33-ed63fd705250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2321dafe-99e2-4e1c-bc33-ed63fd705250 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:07.797894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:07.800784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:07.802618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:07.804062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 91/189] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:07.806159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321dafe-99e2-4e1c-bc33-ed63fd705250 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:07.884295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:07.926492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ae362-dbfd-4c3c-94c8-840172b82306 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:07.956292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321dafe-99e2-4e1c-bc33-ed63fd705250 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:07.971831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed56ee-eb7f-4643-a1c5-19e16e7fd2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:07.972407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed56ee-eb7f-4643-a1c5-19e16e7fd2cf None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:07.972675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed56ee-eb7f-4643-a1c5-19e16e7fd2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:07.972945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed56ee-eb7f-4643-a1c5-19e16e7fd2cf None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:07.973617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed56ee-eb7f-4643-a1c5-19e16e7fd2cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:07.975109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed56ee-eb7f-4643-a1c5-19e16e7fd2cf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:07.998558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7035e-8835-4a03-8b01-503bfcac69c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:07.999255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7035e-8835-4a03-8b01-503bfcac69c2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:07.999533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7035e-8835-4a03-8b01-503bfcac69c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:07.999799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7035e-8835-4a03-8b01-503bfcac69c2 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:08.001062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7035e-8835-4a03-8b01-503bfcac69c2 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:08.002504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7035e-8835-4a03-8b01-503bfcac69c2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:08.004313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 92/190] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:07 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:08.005892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239696f-4f75-4ab8-9612-09ba111e0ec0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:08.006282 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239696f-4f75-4ab8-9612-09ba111e0ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:08.006696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239696f-4f75-4ab8-9612-09ba111e0ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:08.026784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7239696f-4f75-4ab8-9612-09ba111e0ec0 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:08.028660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7239696f-4f75-4ab8-9612-09ba111e0ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:08.057346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:08.086584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 99/191] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:57:07 2022] POST /identity/v3/users => generated 297 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:57:08.100315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed56ee-eb7f-4643-a1c5-19e16e7fd2cf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:08.110333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 93/192] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:08.111497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239696f-4f75-4ab8-9612-09ba111e0ec0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:08.305910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed56ee-eb7f-4643-a1c5-19e16e7fd2cf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:08.328076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239696f-4f75-4ab8-9612-09ba111e0ec0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:08.353587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:08.377250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d8bd-fc46-41a5-8544-b7c88f00dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:08.378618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d8bd-fc46-41a5-8544-b7c88f00dd08 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:08.379070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d8bd-fc46-41a5-8544-b7c88f00dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:08.383741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d8bd-fc46-41a5-8544-b7c88f00dd08 None admin] PATH_INFO: `/v3/users/58f3c159b5524f3bb3620f4d8b563ee7` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:08.405508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7d8bd-fc46-41a5-8544-b7c88f00dd08 None admin] RBAC: Authorizing `identity:get_user(user_id=58f3c159b5524f3bb3620f4d8b563ee7)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:08.405758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b4910-5c7b-448f-ae6f-4948a30f4c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:08.406615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b4910-5c7b-448f-ae6f-4948a30f4c94 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:08.407046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b4910-5c7b-448f-ae6f-4948a30f4c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:08.407516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b4910-5c7b-448f-ae6f-4948a30f4c94 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:08.408053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7d8bd-fc46-41a5-8544-b7c88f00dd08 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:08.408631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b4910-5c7b-448f-ae6f-4948a30f4c94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:08.410195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b4910-5c7b-448f-ae6f-4948a30f4c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:08.411263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 100/193] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:08 2022] GET /identity/v3/users/58f3c159b5524f3bb3620f4d8b563ee7 => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:08.411897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b4910-5c7b-448f-ae6f-4948a30f4c94 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:08.412772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d8bd-fc46-41a5-8544-b7c88f00dd08 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:08.425652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 94/194] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:08.427285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b4910-5c7b-448f-ae6f-4948a30f4c94 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:08.475450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:08.582831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b4910-5c7b-448f-ae6f-4948a30f4c94 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:08.616073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d8bd-fc46-41a5-8544-b7c88f00dd08 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:08.637385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0d51e-d07d-43cd-a411-932310ea7278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:08.638114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0d51e-d07d-43cd-a411-932310ea7278 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:08.638497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0d51e-d07d-43cd-a411-932310ea7278 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:08.638889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0d51e-d07d-43cd-a411-932310ea7278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:08.708127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104b463-6a91-41d5-978f-df8520a6ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:08.709339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104b463-6a91-41d5-978f-df8520a6ea22 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:08.711229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104b463-6a91-41d5-978f-df8520a6ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:08.712077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104b463-6a91-41d5-978f-df8520a6ea22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:08.715331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104b463-6a91-41d5-978f-df8520a6ea22 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=960889d116ab4cb4893fa64b6b0869bb, user.id=05e7d4149924497faf197737573abc5d) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:08.716531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104b463-6a91-41d5-978f-df8520a6ea22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:08.720967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104b463-6a91-41d5-978f-df8520a6ea22 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:08.729008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0d51e-d07d-43cd-a411-932310ea7278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:08.730659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0d51e-d07d-43cd-a411-932310ea7278 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:08.740903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 101/195] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:08 2022] GET /identity/v3/role_assignments?user.id=05e7d4149924497faf197737573abc5d&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:08.745943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104b463-6a91-41d5-978f-df8520a6ea22 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:08.778462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:08.845607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:08.985511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 95/196] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:08.989924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0d51e-d07d-43cd-a411-932310ea7278 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:09.015212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104b463-6a91-41d5-978f-df8520a6ea22 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:09.103241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf522c-bbae-4033-88dc-b2226730dbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:09.104845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf522c-bbae-4033-88dc-b2226730dbfe None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:09.106413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf522c-bbae-4033-88dc-b2226730dbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:09.107149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf522c-bbae-4033-88dc-b2226730dbfe None admin] PATH_INFO: `/v3/users/58f3c159b5524f3bb3620f4d8b563ee7` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:09.109205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0d51e-d07d-43cd-a411-932310ea7278 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:09.109810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf522c-bbae-4033-88dc-b2226730dbfe None admin] RBAC: Authorizing `identity:get_user(user_id=58f3c159b5524f3bb3620f4d8b563ee7)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:09.113019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf522c-bbae-4033-88dc-b2226730dbfe None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:09.116291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 102/197] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:08 2022] GET /identity/v3/users/58f3c159b5524f3bb3620f4d8b563ee7 => generated 283 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:09.117989 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf522c-bbae-4033-88dc-b2226730dbfe None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:09.139064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:09.157604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b17cd5-1723-40ea-9406-29ceb90d4655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:09.158591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17cd5-1723-40ea-9406-29ceb90d4655 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:09.158874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17cd5-1723-40ea-9406-29ceb90d4655 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:09.159148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17cd5-1723-40ea-9406-29ceb90d4655 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:09.175684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b17cd5-1723-40ea-9406-29ceb90d4655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-89b17cd5-1723-40ea-9406-29ceb90d4655 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:09.182289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:09.184720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 96/198] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:09.186280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b17cd5-1723-40ea-9406-29ceb90d4655 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:09.305612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b17cd5-1723-40ea-9406-29ceb90d4655 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:09.349987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab33201-9dbf-4437-be64-f6ed11204d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:09.350618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab33201-9dbf-4437-be64-f6ed11204d10 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:09.351101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab33201-9dbf-4437-be64-f6ed11204d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:09.351380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab33201-9dbf-4437-be64-f6ed11204d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:09.363994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf522c-bbae-4033-88dc-b2226730dbfe None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:09.393044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:09.421567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:09.440528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58471bc-106f-48d3-ac3a-a5247b757638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:09.442180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58471bc-106f-48d3-ac3a-a5247b757638 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:09.442999 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58471bc-106f-48d3-ac3a-a5247b757638 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:09.443822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58471bc-106f-48d3-ac3a-a5247b757638 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:09.444439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab33201-9dbf-4437-be64-f6ed11204d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:09.446075 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab33201-9dbf-4437-be64-f6ed11204d10 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:09.447099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58471bc-106f-48d3-ac3a-a5247b757638 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:09.450099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58471bc-106f-48d3-ac3a-a5247b757638 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:09.453530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 103/199] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:09 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:09.455339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58471bc-106f-48d3-ac3a-a5247b757638 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:09.579004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 97/200] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:09.584431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab33201-9dbf-4437-be64-f6ed11204d10 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:09.666976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58471bc-106f-48d3-ac3a-a5247b757638 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:09.678072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:09.698949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab33201-9dbf-4437-be64-f6ed11204d10 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:09.736978 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08310f5a-84bd-413f-aa51-5aecb72754ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:09.737602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08310f5a-84bd-413f-aa51-5aecb72754ac None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:09.737880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08310f5a-84bd-413f-aa51-5aecb72754ac None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:09.738284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08310f5a-84bd-413f-aa51-5aecb72754ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:09.739036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08310f5a-84bd-413f-aa51-5aecb72754ac None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=4c832ded083c47aab25b1b28396beea6, user.id=58f3c159b5524f3bb3620f4d8b563ee7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:09.739346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08310f5a-84bd-413f-aa51-5aecb72754ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:09.740863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08310f5a-84bd-413f-aa51-5aecb72754ac None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:09.748481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 98/201] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:09 2022] GET /identity/v3/role_assignments?user.id=58f3c159b5524f3bb3620f4d8b563ee7&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:09.749347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08310f5a-84bd-413f-aa51-5aecb72754ac None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:09.750067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7413c9-1b05-4a0b-9f7b-ad84e63a841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:09.751622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7413c9-1b05-4a0b-9f7b-ad84e63a841c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:09.752645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7413c9-1b05-4a0b-9f7b-ad84e63a841c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:09.753530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7413c9-1b05-4a0b-9f7b-ad84e63a841c None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:09.755163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7413c9-1b05-4a0b-9f7b-ad84e63a841c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:09.756044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7413c9-1b05-4a0b-9f7b-ad84e63a841c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:09.759429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7413c9-1b05-4a0b-9f7b-ad84e63a841c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:09.780027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 104/202] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:09.786800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7413c9-1b05-4a0b-9f7b-ad84e63a841c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:09.866022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08310f5a-84bd-413f-aa51-5aecb72754ac None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:09.891950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:09.906517 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848f979-fde7-4394-9a24-082e936f7f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:09.907169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848f979-fde7-4394-9a24-082e936f7f1a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:09.907451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848f979-fde7-4394-9a24-082e936f7f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:09.907726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848f979-fde7-4394-9a24-082e936f7f1a None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:09.908985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848f979-fde7-4394-9a24-082e936f7f1a None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:09.910919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848f979-fde7-4394-9a24-082e936f7f1a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:09.920452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 99/203] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:09 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:09.921885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848f979-fde7-4394-9a24-082e936f7f1a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:09.965386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:10.019923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7413c9-1b05-4a0b-9f7b-ad84e63a841c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:10.070505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848f979-fde7-4394-9a24-082e936f7f1a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:10.128374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3176c-63fa-4018-89a9-7422ba42139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:10.129798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3176c-63fa-4018-89a9-7422ba42139a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:10.130525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3176c-63fa-4018-89a9-7422ba42139a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:10.131264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3176c-63fa-4018-89a9-7422ba42139a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:10.132892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3176c-63fa-4018-89a9-7422ba42139a None admin] RBAC: Adding query filter params (role.id=c76ef09e05ab4b329ff0580b80c56f59, scope.project.id=4c832ded083c47aab25b1b28396beea6, user.id=58f3c159b5524f3bb3620f4d8b563ee7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:10.133721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3176c-63fa-4018-89a9-7422ba42139a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:10.137233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3176c-63fa-4018-89a9-7422ba42139a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:10.138903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fb993-a98d-4bf6-9872-11572a489cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:10.139931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fb993-a98d-4bf6-9872-11572a489cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:10.140418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fb993-a98d-4bf6-9872-11572a489cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:10.140913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fb993-a98d-4bf6-9872-11572a489cb9 None admin] PATH_INFO: `/v3/users/571922bf374242abb33c180ec4c10895` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:10.149296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 100/204] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:09 2022] GET /identity/v3/role_assignments?user.id=58f3c159b5524f3bb3620f4d8b563ee7&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=c76ef09e05ab4b329ff0580b80c56f59 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:10.149519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fb993-a98d-4bf6-9872-11572a489cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=571922bf374242abb33c180ec4c10895)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:10.158791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fb993-a98d-4bf6-9872-11572a489cb9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:10.158791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 105/205] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:09 2022] GET /identity/v3/users/571922bf374242abb33c180ec4c10895 => generated 289 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:10.162858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3176c-63fa-4018-89a9-7422ba42139a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:10.397019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:10.440758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3176c-63fa-4018-89a9-7422ba42139a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:10.518453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f78ed-e8bc-4b11-b8c8-854f670f0f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:10.519475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f78ed-e8bc-4b11-b8c8-854f670f0f41 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:10.520046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f78ed-e8bc-4b11-b8c8-854f670f0f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:10.520586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f78ed-e8bc-4b11-b8c8-854f670f0f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:10.694560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f78ed-e8bc-4b11-b8c8-854f670f0f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:10.696072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f78ed-e8bc-4b11-b8c8-854f670f0f41 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:10.806657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:10.852745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 101/206] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:10.859653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fb993-a98d-4bf6-9872-11572a489cb9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:11.107037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fb993-a98d-4bf6-9872-11572a489cb9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:11.139070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:11.192081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4d279-9739-44c5-bf04-bf0234a23e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:11.193205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4d279-9739-44c5-bf04-bf0234a23e89 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:11.193707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4d279-9739-44c5-bf04-bf0234a23e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:11.194194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4d279-9739-44c5-bf04-bf0234a23e89 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:11.201463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4d279-9739-44c5-bf04-bf0234a23e89 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:11.203934 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4d279-9739-44c5-bf04-bf0234a23e89 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:11.207180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 106/207] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:10 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:11.214294 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f78ed-e8bc-4b11-b8c8-854f670f0f41 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:11.401152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ba87-f866-4fec-a2eb-5558c6ea5e4b None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:11.401636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ba87-f866-4fec-a2eb-5558c6ea5e4b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:11.401942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ba87-f866-4fec-a2eb-5558c6ea5e4b None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:11.404518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 107/208] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:11.413700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910201f-6d99-455c-a7fe-981149243bfb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:11.414198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910201f-6d99-455c-a7fe-981149243bfb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:11.414693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910201f-6d99-455c-a7fe-981149243bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:11.444400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4910201f-6d99-455c-a7fe-981149243bfb None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:11.445619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4910201f-6d99-455c-a7fe-981149243bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:11.487183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f78ed-e8bc-4b11-b8c8-854f670f0f41 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:11.576489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566395-d9a8-4f19-826d-e1df6551fa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:11.577556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566395-d9a8-4f19-826d-e1df6551fa6b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:11.579134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566395-d9a8-4f19-826d-e1df6551fa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:11.579689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566395-d9a8-4f19-826d-e1df6551fa6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:11.580882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566395-d9a8-4f19-826d-e1df6551fa6b None admin] RBAC: Adding query filter params (role.id=57523b6804424d1782f8e7df8974669f, scope.project.id=960889d116ab4cb4893fa64b6b0869bb, user.id=571922bf374242abb33c180ec4c10895) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:11.583396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566395-d9a8-4f19-826d-e1df6551fa6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:11.585995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566395-d9a8-4f19-826d-e1df6551fa6b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:11.608251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 102/209] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:11 2022] GET /identity/v3/role_assignments?user.id=571922bf374242abb33c180ec4c10895&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=57523b6804424d1782f8e7df8974669f => generated 608 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:11.619199 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 108/210] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:11.674607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41e6ee-dd53-49d8-819d-7230c237f14d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:11.675145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41e6ee-dd53-49d8-819d-7230c237f14d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:11.675332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41e6ee-dd53-49d8-819d-7230c237f14d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:11.677249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 103/211] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:11.683124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee2f24-c72d-4bbf-8825-432a421adf29 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:11.683998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee2f24-c72d-4bbf-8825-432a421adf29 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:11.684286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee2f24-c72d-4bbf-8825-432a421adf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:11.711601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a3ee2f24-c72d-4bbf-8825-432a421adf29 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:11.712853 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a3ee2f24-c72d-4bbf-8825-432a421adf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:11.846951 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 109/212] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:12.156557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41e6ee-dd53-49d8-819d-7230c237f14d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:12.169663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee2f24-c72d-4bbf-8825-432a421adf29 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:12.230362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:12.268147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:12.314821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee2f24-c72d-4bbf-8825-432a421adf29 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:12.367784 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a92d5-326b-4219-b965-b7222e1cd3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:12.368477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a92d5-326b-4219-b965-b7222e1cd3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:12.368756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a92d5-326b-4219-b965-b7222e1cd3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:12.369026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a92d5-326b-4219-b965-b7222e1cd3c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:12.372465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41e6ee-dd53-49d8-819d-7230c237f14d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:12.383212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a92d5-326b-4219-b965-b7222e1cd3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b93a92d5-326b-4219-b965-b7222e1cd3c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:12.389813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:12.391918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 110/213] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:12.393390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e18c7-f018-4e17-baaf-ae772491772e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:12.394720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e18c7-f018-4e17-baaf-ae772491772e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:12.394720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e18c7-f018-4e17-baaf-ae772491772e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:12.396394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 111/214] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:12.398967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e18c7-f018-4e17-baaf-ae772491772e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:12.420449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039998d-a942-493d-b274-f8713c00b68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:12.421016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039998d-a942-493d-b274-f8713c00b68a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:12.421296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039998d-a942-493d-b274-f8713c00b68a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:12.421561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039998d-a942-493d-b274-f8713c00b68a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:12.422730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039998d-a942-493d-b274-f8713c00b68a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:12.424497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039998d-a942-493d-b274-f8713c00b68a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:12.426482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 104/215] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:12.427697 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dabf6-7c0d-40f1-8c5e-8beb9db290f8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:12.427988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dabf6-7c0d-40f1-8c5e-8beb9db290f8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:12.428284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dabf6-7c0d-40f1-8c5e-8beb9db290f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:12.448097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-978dabf6-7c0d-40f1-8c5e-8beb9db290f8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:12.449884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-978dabf6-7c0d-40f1-8c5e-8beb9db290f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:12.524325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 105/216] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:12.530464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dabf6-7c0d-40f1-8c5e-8beb9db290f8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:12.562069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:12.570246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e18c7-f018-4e17-baaf-ae772491772e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:12.589318 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:12.651050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857306b-f9b4-415f-8d89-63e3f27e6bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:12.652804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857306b-f9b4-415f-8d89-63e3f27e6bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:12.653557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857306b-f9b4-415f-8d89-63e3f27e6bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:12.654359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857306b-f9b4-415f-8d89-63e3f27e6bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:12.655654 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dabf6-7c0d-40f1-8c5e-8beb9db290f8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:12.656181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857306b-f9b4-415f-8d89-63e3f27e6bb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:12.657026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857306b-f9b4-415f-8d89-63e3f27e6bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:12.660246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857306b-f9b4-415f-8d89-63e3f27e6bb2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:12.678297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 112/217] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:12.690173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857306b-f9b4-415f-8d89-63e3f27e6bb2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:12.701164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30925a-fef4-41d9-ab4c-4e82a6b9f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:12.701792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30925a-fef4-41d9-ab4c-4e82a6b9f397 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:12.702068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30925a-fef4-41d9-ab4c-4e82a6b9f397 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:12.702325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30925a-fef4-41d9-ab4c-4e82a6b9f397 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:12.703056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30925a-fef4-41d9-ab4c-4e82a6b9f397 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:12.704574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30925a-fef4-41d9-ab4c-4e82a6b9f397 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:12.837379 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 106/218] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:57:12 2022] POST /identity/v3/users => generated 297 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:57:12.907349 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857306b-f9b4-415f-8d89-63e3f27e6bb2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:12.929687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30925a-fef4-41d9-ab4c-4e82a6b9f397 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:12.973735 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a167d-6929-4a66-8361-ecdbeafd697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:12.975129 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a167d-6929-4a66-8361-ecdbeafd697d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:12.975766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a167d-6929-4a66-8361-ecdbeafd697d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:12.976618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a167d-6929-4a66-8361-ecdbeafd697d None admin] PATH_INFO: `/v3/users/80b9488c846c4c338d7ac0e0fd802632` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:13.003489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a167d-6929-4a66-8361-ecdbeafd697d None admin] RBAC: Authorizing `identity:get_user(user_id=80b9488c846c4c338d7ac0e0fd802632)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:13.006478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a167d-6929-4a66-8361-ecdbeafd697d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:13.009737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 113/219] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:12 2022] GET /identity/v3/users/80b9488c846c4c338d7ac0e0fd802632 => generated 297 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:13.018314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de761a8c-d7c7-4426-a1a0-213e1d02eff6 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:13.018314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de761a8c-d7c7-4426-a1a0-213e1d02eff6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:13.018314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de761a8c-d7c7-4426-a1a0-213e1d02eff6 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:13.019377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 114/220] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:13.020113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de761a8c-d7c7-4426-a1a0-213e1d02eff6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:13.049317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:13.129132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:13.137529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30925a-fef4-41d9-ab4c-4e82a6b9f397 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:13.197967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de761a8c-d7c7-4426-a1a0-213e1d02eff6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:13.204636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac65f87-5c0b-4c0f-aa71-1cfb5a1a7538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:13.207109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac65f87-5c0b-4c0f-aa71-1cfb5a1a7538 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:13.207109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac65f87-5c0b-4c0f-aa71-1cfb5a1a7538 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:13.207109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac65f87-5c0b-4c0f-aa71-1cfb5a1a7538 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:13.228945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac65f87-5c0b-4c0f-aa71-1cfb5a1a7538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8ac65f87-5c0b-4c0f-aa71-1cfb5a1a7538 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:13.234635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:13.235616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:13.236664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 107/221] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:57:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:57:13.237421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165516-9143-46ec-bf91-45f1003a66df None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:13.237421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165516-9143-46ec-bf91-45f1003a66df None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:13.237677 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165516-9143-46ec-bf91-45f1003a66df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:13.265975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9a165516-9143-46ec-bf91-45f1003a66df None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:13.267248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9a165516-9143-46ec-bf91-45f1003a66df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:13.277098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d882d3-de5c-4984-ae62-3759a45728c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:13.278247 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d882d3-de5c-4984-ae62-3759a45728c6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:13.278904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d882d3-de5c-4984-ae62-3759a45728c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:13.279349 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d882d3-de5c-4984-ae62-3759a45728c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:13.381627 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 108/222] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:13.382926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165516-9143-46ec-bf91-45f1003a66df None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:13.417233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d882d3-de5c-4984-ae62-3759a45728c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:13.420967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d882d3-de5c-4984-ae62-3759a45728c6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:13.462546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:13.618492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 115/223] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:13.633953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d882d3-de5c-4984-ae62-3759a45728c6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:13.642800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:13.668382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165516-9143-46ec-bf91-45f1003a66df None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:13.742532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f805e1-805c-42f8-962f-704bf1a15994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:13.743433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f805e1-805c-42f8-962f-704bf1a15994 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:13.744006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f805e1-805c-42f8-962f-704bf1a15994 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:13.744429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f805e1-805c-42f8-962f-704bf1a15994 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:13.745739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f805e1-805c-42f8-962f-704bf1a15994 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:13.746277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f805e1-805c-42f8-962f-704bf1a15994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:13.749044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f805e1-805c-42f8-962f-704bf1a15994 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:13.765808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 109/224] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:13.776046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f805e1-805c-42f8-962f-704bf1a15994 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:13.963316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d882d3-de5c-4984-ae62-3759a45728c6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:14.008260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:14.041307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4547ab8-014d-4c03-9d79-93ca8adf7eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:14.042774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4547ab8-014d-4c03-9d79-93ca8adf7eec None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:14.043482 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4547ab8-014d-4c03-9d79-93ca8adf7eec None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:14.044156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4547ab8-014d-4c03-9d79-93ca8adf7eec None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:14.046821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4547ab8-014d-4c03-9d79-93ca8adf7eec None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:14.051325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4547ab8-014d-4c03-9d79-93ca8adf7eec None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:14.059857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 116/225] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:13 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:14.062357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4547ab8-014d-4c03-9d79-93ca8adf7eec None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:14.111762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f805e1-805c-42f8-962f-704bf1a15994 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:14.194942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cd9a4-e34c-4e3c-90a7-94dbc1f65be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:14.196602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd9a4-e34c-4e3c-90a7-94dbc1f65be9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:14.197374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd9a4-e34c-4e3c-90a7-94dbc1f65be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:14.198414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd9a4-e34c-4e3c-90a7-94dbc1f65be9 None admin] PATH_INFO: `/v3/users/58f3c159b5524f3bb3620f4d8b563ee7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:14.202541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cd9a4-e34c-4e3c-90a7-94dbc1f65be9 None admin] RBAC: Authorizing `identity:get_user(user_id=58f3c159b5524f3bb3620f4d8b563ee7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:14.205999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cd9a4-e34c-4e3c-90a7-94dbc1f65be9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:14.210617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 110/226] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:13 2022] GET /identity/v3/users/58f3c159b5524f3bb3620f4d8b563ee7 => generated 283 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:14.212529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cd9a4-e34c-4e3c-90a7-94dbc1f65be9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:14.263985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:14.318808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4547ab8-014d-4c03-9d79-93ca8adf7eec None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:14.397169 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af425d-2faf-4068-bd9a-ebdb3ea9465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:14.398193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af425d-2faf-4068-bd9a-ebdb3ea9465c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:14.398666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af425d-2faf-4068-bd9a-ebdb3ea9465c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:14.399125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af425d-2faf-4068-bd9a-ebdb3ea9465c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:14.424028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af425d-2faf-4068-bd9a-ebdb3ea9465c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c3af425d-2faf-4068-bd9a-ebdb3ea9465c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:14.440005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:14.441997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 117/227] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:14.443566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af425d-2faf-4068-bd9a-ebdb3ea9465c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:14.460172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cd9a4-e34c-4e3c-90a7-94dbc1f65be9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:14.530937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e893b66-bb70-440f-b61d-2e1461cadaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:14.531876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e893b66-bb70-440f-b61d-2e1461cadaae None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:14.532423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e893b66-bb70-440f-b61d-2e1461cadaae None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:14.532904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e893b66-bb70-440f-b61d-2e1461cadaae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:14.534694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e893b66-bb70-440f-b61d-2e1461cadaae None admin] RBAC: Adding query filter params (role.id=4a2e97979a4c4cd796f797f81fff095a, scope.project.id=4c832ded083c47aab25b1b28396beea6, user.id=80b9488c846c4c338d7ac0e0fd802632) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:14.535065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e893b66-bb70-440f-b61d-2e1461cadaae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:14.538040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e893b66-bb70-440f-b61d-2e1461cadaae None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:14.547572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:14.551595 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 111/228] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:14 2022] GET /identity/v3/role_assignments?user.id=80b9488c846c4c338d7ac0e0fd802632&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:14.553128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e893b66-bb70-440f-b61d-2e1461cadaae None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:14.650328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af425d-2faf-4068-bd9a-ebdb3ea9465c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:14.721027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccbc42-4442-439e-a5ab-10bca8ae00c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:14.722835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccbc42-4442-439e-a5ab-10bca8ae00c0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:14.723573 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccbc42-4442-439e-a5ab-10bca8ae00c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:14.724344 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccbc42-4442-439e-a5ab-10bca8ae00c0 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:14.726721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccbc42-4442-439e-a5ab-10bca8ae00c0 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:14.730438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccbc42-4442-439e-a5ab-10bca8ae00c0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:14.733074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:14.734467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 118/229] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:14 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:14.745117 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccbc42-4442-439e-a5ab-10bca8ae00c0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:14.773111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e893b66-bb70-440f-b61d-2e1461cadaae None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:14.845938 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a972acb-23e4-4075-ab87-ddaaf8f9206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:14.846861 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a972acb-23e4-4075-ab87-ddaaf8f9206f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:14.847348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a972acb-23e4-4075-ab87-ddaaf8f9206f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:14.847820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a972acb-23e4-4075-ab87-ddaaf8f9206f None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:14.849073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a972acb-23e4-4075-ab87-ddaaf8f9206f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:14.849606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a972acb-23e4-4075-ab87-ddaaf8f9206f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:14.852248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a972acb-23e4-4075-ab87-ddaaf8f9206f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:14.885322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 112/230] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:14.899367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a972acb-23e4-4075-ab87-ddaaf8f9206f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:15.104228 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccbc42-4442-439e-a5ab-10bca8ae00c0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:15.139161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:15.162883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a972acb-23e4-4075-ab87-ddaaf8f9206f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:15.197937 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4d68c-3626-42ec-a4b5-dd6ab695be20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:15.199706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4d68c-3626-42ec-a4b5-dd6ab695be20 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:15.200227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4d68c-3626-42ec-a4b5-dd6ab695be20 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:15.201156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4d68c-3626-42ec-a4b5-dd6ab695be20 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6/users/58f3c159b5524f3bb3620f4d8b563ee7/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:15.204351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4d68c-3626-42ec-a4b5-dd6ab695be20 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c832ded083c47aab25b1b28396beea6, user_id=58f3c159b5524f3bb3620f4d8b563ee7, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:15.213219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4d68c-3626-42ec-a4b5-dd6ab695be20 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:15.234603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45ba07-31cf-4f7f-becf-9de79b9ac1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:15.236235 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45ba07-31cf-4f7f-becf-9de79b9ac1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:15.236951 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45ba07-31cf-4f7f-becf-9de79b9ac1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:15.237815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45ba07-31cf-4f7f-becf-9de79b9ac1e5 None admin] PATH_INFO: `/v3/users/58f3c159b5524f3bb3620f4d8b563ee7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:15.240128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45ba07-31cf-4f7f-becf-9de79b9ac1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=58f3c159b5524f3bb3620f4d8b563ee7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:15.243286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45ba07-31cf-4f7f-becf-9de79b9ac1e5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:15.247607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 113/231] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:14 2022] GET /identity/v3/users/58f3c159b5524f3bb3620f4d8b563ee7 => generated 283 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:15.255557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45ba07-31cf-4f7f-becf-9de79b9ac1e5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:15.287295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:15.305801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 119/232] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:57:14 2022] PUT /identity/v3/projects/4c832ded083c47aab25b1b28396beea6/users/58f3c159b5524f3bb3620f4d8b563ee7/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 11:57:15.478364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45ba07-31cf-4f7f-becf-9de79b9ac1e5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:15.522166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf42c8-f3bb-4229-ba24-9b0a887df858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:15.522829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf42c8-f3bb-4229-ba24-9b0a887df858 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:15.523107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf42c8-f3bb-4229-ba24-9b0a887df858 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:15.523382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf42c8-f3bb-4229-ba24-9b0a887df858 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:15.524639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf42c8-f3bb-4229-ba24-9b0a887df858 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:15.526251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf42c8-f3bb-4229-ba24-9b0a887df858 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:15.528844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 114/233] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:15 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:15.538407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4d68c-3626-42ec-a4b5-dd6ab695be20 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:15.788102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4d68c-3626-42ec-a4b5-dd6ab695be20 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:15.800396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b2b5c-ab8d-49f4-aa1c-e9a098755a4f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:15.800857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b2b5c-ab8d-49f4-aa1c-e9a098755a4f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:15.801044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b2b5c-ab8d-49f4-aa1c-e9a098755a4f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:15.802635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 115/234] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:15.809763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481cc0a-1029-4287-8453-c097df83c601 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:15.810155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481cc0a-1029-4287-8453-c097df83c601 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:15.810404 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481cc0a-1029-4287-8453-c097df83c601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:15.830682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4481cc0a-1029-4287-8453-c097df83c601 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:15.831906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4481cc0a-1029-4287-8453-c097df83c601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:15.862513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c0a26-a64b-4134-8c23-6aa8c4f9e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:15.864134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c0a26-a64b-4134-8c23-6aa8c4f9e285 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:15.864910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c0a26-a64b-4134-8c23-6aa8c4f9e285 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:15.865755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c0a26-a64b-4134-8c23-6aa8c4f9e285 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6/users/58f3c159b5524f3bb3620f4d8b563ee7/roles/c76ef09e05ab4b329ff0580b80c56f59` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:15.871949 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c0a26-a64b-4134-8c23-6aa8c4f9e285 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c832ded083c47aab25b1b28396beea6, user_id=58f3c159b5524f3bb3620f4d8b563ee7, role_id=c76ef09e05ab4b329ff0580b80c56f59)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:15.874723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c0a26-a64b-4134-8c23-6aa8c4f9e285 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:15.910914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 116/235] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:16.008371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 120/236] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:57:15 2022] PUT /identity/v3/projects/4c832ded083c47aab25b1b28396beea6/users/58f3c159b5524f3bb3620f4d8b563ee7/roles/c76ef09e05ab4b329ff0580b80c56f59 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:57:16.478004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481cc0a-1029-4287-8453-c097df83c601 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:16.502847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:16.710207 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481cc0a-1029-4287-8453-c097df83c601 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:16.790342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f6f0-6658-4c31-b918-35244b5f4352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:16.791336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f6f0-6658-4c31-b918-35244b5f4352 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:16.791999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f6f0-6658-4c31-b918-35244b5f4352 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:16.793192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f6f0-6658-4c31-b918-35244b5f4352 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:16.820959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53ed50-e1e1-49e4-9684-8386c4d580a4 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:16.821734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53ed50-e1e1-49e4-9684-8386c4d580a4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:16.822047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53ed50-e1e1-49e4-9684-8386c4d580a4 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:16.824684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 121/237] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:16.832550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f6f0-6658-4c31-b918-35244b5f4352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:16.834276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7760-2d5f-42b9-b1c8-d0a7d230e8cf None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:16.835221 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7760-2d5f-42b9-b1c8-d0a7d230e8cf None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:16.835966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7760-2d5f-42b9-b1c8-d0a7d230e8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3275f6f0-6658-4c31-b918-35244b5f4352 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:16.845578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:16.847376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:16.849631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 117/238] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:16.861309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f6f0-6658-4c31-b918-35244b5f4352 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:16.902642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-020d7760-2d5f-42b9-b1c8-d0a7d230e8cf None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:16.907270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-020d7760-2d5f-42b9-b1c8-d0a7d230e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:17.015923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:17.083178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:17.143807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f6f0-6658-4c31-b918-35244b5f4352 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:17.158910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 122/239] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:17.217817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417583e-cf31-4923-9c1b-6e1356a7ca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:17.218864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417583e-cf31-4923-9c1b-6e1356a7ca08 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:17.219344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417583e-cf31-4923-9c1b-6e1356a7ca08 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:17.219823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417583e-cf31-4923-9c1b-6e1356a7ca08 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:17.221085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417583e-cf31-4923-9c1b-6e1356a7ca08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:17.221553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417583e-cf31-4923-9c1b-6e1356a7ca08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:17.223840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417583e-cf31-4923-9c1b-6e1356a7ca08 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:17.249965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 118/240] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:17.258957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7760-2d5f-42b9-b1c8-d0a7d230e8cf None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:17.473970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7760-2d5f-42b9-b1c8-d0a7d230e8cf None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:17.533998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977b54f-4e1c-4d6e-8a6a-fd755f80a82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:17.535106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b54f-4e1c-4d6e-8a6a-fd755f80a82a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:17.535592 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b54f-4e1c-4d6e-8a6a-fd755f80a82a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:17.536074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b54f-4e1c-4d6e-8a6a-fd755f80a82a None admin] PATH_INFO: `/v3/users/6ab2c42c63dc45b88a874856252c7dba` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:17.563269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977b54f-4e1c-4d6e-8a6a-fd755f80a82a None admin] RBAC: Authorizing `identity:get_user(user_id=6ab2c42c63dc45b88a874856252c7dba)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:17.565123 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977b54f-4e1c-4d6e-8a6a-fd755f80a82a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:17.567420 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 123/241] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:17 2022] GET /identity/v3/users/6ab2c42c63dc45b88a874856252c7dba => generated 297 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:17.576504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417583e-cf31-4923-9c1b-6e1356a7ca08 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:17.813320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417583e-cf31-4923-9c1b-6e1356a7ca08 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:17.857739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977b54f-4e1c-4d6e-8a6a-fd755f80a82a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:17.871336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:17.881169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913a1f6-11db-4ed8-95cd-321c36cbabc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:17.882385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913a1f6-11db-4ed8-95cd-321c36cbabc0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:17.904468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913a1f6-11db-4ed8-95cd-321c36cbabc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:17.904468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913a1f6-11db-4ed8-95cd-321c36cbabc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:17.925864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:18.021720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913a1f6-11db-4ed8-95cd-321c36cbabc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:18.024683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913a1f6-11db-4ed8-95cd-321c36cbabc0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:18.127229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977b54f-4e1c-4d6e-8a6a-fd755f80a82a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:18.208033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab17409-3ee9-49b8-bb86-bac0d232c5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:18.209475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab17409-3ee9-49b8-bb86-bac0d232c5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:18.210637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab17409-3ee9-49b8-bb86-bac0d232c5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:18.211115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab17409-3ee9-49b8-bb86-bac0d232c5b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:18.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab17409-3ee9-49b8-bb86-bac0d232c5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:18.217570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab17409-3ee9-49b8-bb86-bac0d232c5b5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:18.220712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 124/242] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:57:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:18.222896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382654b-7a11-4184-a236-8f3600c52dd5 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:18.223398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382654b-7a11-4184-a236-8f3600c52dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:18.223886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382654b-7a11-4184-a236-8f3600c52dd5 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:18.226401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 125/243] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:18.235927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af1e5f-5b48-41b1-ae1f-2a380ec1c50a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:18.236480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af1e5f-5b48-41b1-ae1f-2a380ec1c50a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:18.237032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af1e5f-5b48-41b1-ae1f-2a380ec1c50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:18.241074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 119/244] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:18.242499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913a1f6-11db-4ed8-95cd-321c36cbabc0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:18.279736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e8af1e5f-5b48-41b1-ae1f-2a380ec1c50a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:18.282096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e8af1e5f-5b48-41b1-ae1f-2a380ec1c50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:18.351675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:18.408829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 126/245] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:18.410265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af1e5f-5b48-41b1-ae1f-2a380ec1c50a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:18.446851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913a1f6-11db-4ed8-95cd-321c36cbabc0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:18.456787 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:18.527810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30ad7e-7c9e-46fa-b9ef-40afca8f7f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:18.529605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30ad7e-7c9e-46fa-b9ef-40afca8f7f89 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:18.530101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30ad7e-7c9e-46fa-b9ef-40afca8f7f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:18.531896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30ad7e-7c9e-46fa-b9ef-40afca8f7f89 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:18.533206 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30ad7e-7c9e-46fa-b9ef-40afca8f7f89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:18.536158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30ad7e-7c9e-46fa-b9ef-40afca8f7f89 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:18.611848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af1e5f-5b48-41b1-ae1f-2a380ec1c50a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:18.672122 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 120/246] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:57:18 2022] POST /identity/v3/users => generated 293 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:57:18.674428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07239cdd-056c-4c64-9894-ef989adcbeeb None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:18.675169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07239cdd-056c-4c64-9894-ef989adcbeeb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:18.675702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07239cdd-056c-4c64-9894-ef989adcbeeb None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:18.681818 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdc9d6-c9fe-415a-ba2e-a5ecec1fe94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:18.683869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc9d6-c9fe-415a-ba2e-a5ecec1fe94e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:18.684602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 121/247] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:18.684994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc9d6-c9fe-415a-ba2e-a5ecec1fe94e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:18.685745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc9d6-c9fe-415a-ba2e-a5ecec1fe94e None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:18.688427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdc9d6-c9fe-415a-ba2e-a5ecec1fe94e None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:18.690141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831ca2-4e70-42d2-99b9-7add824f3da8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:18.690693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831ca2-4e70-42d2-99b9-7add824f3da8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:18.691082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831ca2-4e70-42d2-99b9-7add824f3da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:18.692453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdc9d6-c9fe-415a-ba2e-a5ecec1fe94e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:18.696726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 127/248] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:18 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:18.715923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdc9d6-c9fe-415a-ba2e-a5ecec1fe94e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:18.766516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c8831ca2-4e70-42d2-99b9-7add824f3da8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:18.769171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c8831ca2-4e70-42d2-99b9-7add824f3da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:18.898838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 122/249] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:18.899909 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8831ca2-4e70-42d2-99b9-7add824f3da8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:18.921906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:18.968697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:18.987061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdc9d6-c9fe-415a-ba2e-a5ecec1fe94e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:19.031693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8831ca2-4e70-42d2-99b9-7add824f3da8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:19.063877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6944c2-6a57-48e6-bb44-262eacdee450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:19.065045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6944c2-6a57-48e6-bb44-262eacdee450 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:19.065543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6944c2-6a57-48e6-bb44-262eacdee450 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:19.066055 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6944c2-6a57-48e6-bb44-262eacdee450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:19.067648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6944c2-6a57-48e6-bb44-262eacdee450 None admin] RBAC: Adding query filter params (role.id=57523b6804424d1782f8e7df8974669f, scope.project.id=4c832ded083c47aab25b1b28396beea6, user.id=6ab2c42c63dc45b88a874856252c7dba) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:19.068246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6944c2-6a57-48e6-bb44-262eacdee450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:19.072434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6944c2-6a57-48e6-bb44-262eacdee450 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:19.081590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63580685-08d6-43c4-b295-55ed32bfa8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:19.083240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63580685-08d6-43c4-b295-55ed32bfa8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:19.083502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 128/250] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:18 2022] GET /identity/v3/role_assignments?user.id=6ab2c42c63dc45b88a874856252c7dba&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=57523b6804424d1782f8e7df8974669f => generated 259 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:19.083903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63580685-08d6-43c4-b295-55ed32bfa8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:19.084346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63580685-08d6-43c4-b295-55ed32bfa8e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:19.098116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63580685-08d6-43c4-b295-55ed32bfa8e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-63580685-08d6-43c4-b295-55ed32bfa8e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:19.103843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:19.105571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:19.106390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:19.108658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 123/251] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:19.115115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6944c2-6a57-48e6-bb44-262eacdee450 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:19.247186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6944c2-6a57-48e6-bb44-262eacdee450 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:19.289386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d6346-d848-4f7c-a5c7-98d0d1554451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:19.290294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d6346-d848-4f7c-a5c7-98d0d1554451 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:19.290723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d6346-d848-4f7c-a5c7-98d0d1554451 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:19.291143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d6346-d848-4f7c-a5c7-98d0d1554451 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:19.291990 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d6346-d848-4f7c-a5c7-98d0d1554451 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:19.292873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d6346-d848-4f7c-a5c7-98d0d1554451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:19.294330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d6346-d848-4f7c-a5c7-98d0d1554451 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:19.308707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 129/252] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:19.311279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63580685-08d6-43c4-b295-55ed32bfa8e8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:19.321932 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd4563-5ee1-4110-8844-dfef8999bb52 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:19.322265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd4563-5ee1-4110-8844-dfef8999bb52 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:19.322498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd4563-5ee1-4110-8844-dfef8999bb52 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:19.324109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 130/253] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:19.329574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f5e8d-0449-429c-aa1c-c87ac7668e91 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:19.329860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f5e8d-0449-429c-aa1c-c87ac7668e91 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:19.330120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f5e8d-0449-429c-aa1c-c87ac7668e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:19.350463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4b6f5e8d-0449-429c-aa1c-c87ac7668e91 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:19.351686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4b6f5e8d-0449-429c-aa1c-c87ac7668e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:19.368645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:19.431689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:19.459769 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 131/254] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:19.461243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f5e8d-0449-429c-aa1c-c87ac7668e91 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:19.473479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63580685-08d6-43c4-b295-55ed32bfa8e8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:19.524404 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27aaba-abba-43d7-87ba-3287d2499d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:19.525421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27aaba-abba-43d7-87ba-3287d2499d15 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:19.525908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27aaba-abba-43d7-87ba-3287d2499d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:19.526388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27aaba-abba-43d7-87ba-3287d2499d15 None admin] PATH_INFO: `/v3/users/80b9488c846c4c338d7ac0e0fd802632` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:19.528516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27aaba-abba-43d7-87ba-3287d2499d15 None admin] RBAC: Authorizing `identity:get_user(user_id=80b9488c846c4c338d7ac0e0fd802632)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:19.530291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27aaba-abba-43d7-87ba-3287d2499d15 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:19.532611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 124/255] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:19 2022] GET /identity/v3/users/80b9488c846c4c338d7ac0e0fd802632 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:19.539981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27aaba-abba-43d7-87ba-3287d2499d15 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:19.679337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f5e8d-0449-429c-aa1c-c87ac7668e91 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:19.761868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4ef9b-d007-4ad4-b049-405e73ced3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:19.762970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4ef9b-d007-4ad4-b049-405e73ced3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:19.764601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4ef9b-d007-4ad4-b049-405e73ced3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:19.765099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4ef9b-d007-4ad4-b049-405e73ced3f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:19.788144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4ef9b-d007-4ad4-b049-405e73ced3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-98b4ef9b-d007-4ad4-b049-405e73ced3f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:19.796842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:19.797974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:19.798764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 132/256] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:57:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:19.799655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4ef9b-d007-4ad4-b049-405e73ced3f3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:19.802908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27aaba-abba-43d7-87ba-3287d2499d15 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:19.821203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:19.903657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df58ab-be7c-492c-8605-5a287109350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:19.904765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df58ab-be7c-492c-8605-5a287109350c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:19.905245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df58ab-be7c-492c-8605-5a287109350c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:19.905742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df58ab-be7c-492c-8605-5a287109350c None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:19.912197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df58ab-be7c-492c-8605-5a287109350c None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:19.915067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df58ab-be7c-492c-8605-5a287109350c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:19.927760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 125/257] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:19 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:19.929406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df58ab-be7c-492c-8605-5a287109350c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:19.990322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:20.002589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4ef9b-d007-4ad4-b049-405e73ced3f3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:20.076456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa077-3080-409b-96f0-e3637f89a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:20.077217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa077-3080-409b-96f0-e3637f89a5ff None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:20.077722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa077-3080-409b-96f0-e3637f89a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:20.078219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa077-3080-409b-96f0-e3637f89a5ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:20.117437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3aa077-3080-409b-96f0-e3637f89a5ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:20.121914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df58ab-be7c-492c-8605-5a287109350c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8a3aa077-3080-409b-96f0-e3637f89a5ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:20.135778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:20.138028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:20.140149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:20.141681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 133/258] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:20.144529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa077-3080-409b-96f0-e3637f89a5ff None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:20.180983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186b045-14d5-4d88-8df2-4b6072dad77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:20.181613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186b045-14d5-4d88-8df2-4b6072dad77b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:20.181891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186b045-14d5-4d88-8df2-4b6072dad77b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:20.182165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186b045-14d5-4d88-8df2-4b6072dad77b None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:20.182915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186b045-14d5-4d88-8df2-4b6072dad77b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:20.184708 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186b045-14d5-4d88-8df2-4b6072dad77b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:20.186113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186b045-14d5-4d88-8df2-4b6072dad77b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:20.210748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 126/259] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:20.211635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186b045-14d5-4d88-8df2-4b6072dad77b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:20.290988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:20.366447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:20.386700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa077-3080-409b-96f0-e3637f89a5ff None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:20.392844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186b045-14d5-4d88-8df2-4b6072dad77b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:20.434755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dfb62-4fa6-4fb5-a6f6-246dfa5a0665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:20.435395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dfb62-4fa6-4fb5-a6f6-246dfa5a0665 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:20.435674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dfb62-4fa6-4fb5-a6f6-246dfa5a0665 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:20.435949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dfb62-4fa6-4fb5-a6f6-246dfa5a0665 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:20.436690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dfb62-4fa6-4fb5-a6f6-246dfa5a0665 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:20.436995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dfb62-4fa6-4fb5-a6f6-246dfa5a0665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:20.438437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dfb62-4fa6-4fb5-a6f6-246dfa5a0665 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:20.448033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 127/260] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:20.448994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dfb62-4fa6-4fb5-a6f6-246dfa5a0665 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:20.515416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b1bfd-3785-4e61-812c-77769aa703f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:20.516878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b1bfd-3785-4e61-812c-77769aa703f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:20.517519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b1bfd-3785-4e61-812c-77769aa703f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:20.518013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b1bfd-3785-4e61-812c-77769aa703f1 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6/users/80b9488c846c4c338d7ac0e0fd802632/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:20.527750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b1bfd-3785-4e61-812c-77769aa703f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c832ded083c47aab25b1b28396beea6, user_id=80b9488c846c4c338d7ac0e0fd802632, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:20.532131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b1bfd-3785-4e61-812c-77769aa703f1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:20.572920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dfb62-4fa6-4fb5-a6f6-246dfa5a0665 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:20.611301 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b3ce4-ba66-46f1-8b52-f06540abd92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:20.611950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b3ce4-ba66-46f1-8b52-f06540abd92c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:20.612237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b3ce4-ba66-46f1-8b52-f06540abd92c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:20.612543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b3ce4-ba66-46f1-8b52-f06540abd92c None admin] PATH_INFO: `/v3/users/58f3c159b5524f3bb3620f4d8b563ee7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:20.613760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b3ce4-ba66-46f1-8b52-f06540abd92c None admin] RBAC: Authorizing `identity:get_user(user_id=58f3c159b5524f3bb3620f4d8b563ee7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:20.615225 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b3ce4-ba66-46f1-8b52-f06540abd92c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:20.617465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 128/261] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:20 2022] GET /identity/v3/users/58f3c159b5524f3bb3620f4d8b563ee7 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:20.618065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b3ce4-ba66-46f1-8b52-f06540abd92c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:20.627851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:20.628892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 134/262] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:57:20 2022] PUT /identity/v3/projects/4c832ded083c47aab25b1b28396beea6/users/80b9488c846c4c338d7ac0e0fd802632/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:57:20.633931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b1bfd-3785-4e61-812c-77769aa703f1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:20.738468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b3ce4-ba66-46f1-8b52-f06540abd92c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:20.778197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f236a-0671-4cf0-b626-8a4b4edb6d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:20.779139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f236a-0671-4cf0-b626-8a4b4edb6d12 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:20.779565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f236a-0671-4cf0-b626-8a4b4edb6d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:20.780017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f236a-0671-4cf0-b626-8a4b4edb6d12 None admin] PATH_INFO: `/v3/users/58f3c159b5524f3bb3620f4d8b563ee7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:20.781456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f236a-0671-4cf0-b626-8a4b4edb6d12 None admin] RBAC: Authorizing `identity:get_user(user_id=58f3c159b5524f3bb3620f4d8b563ee7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:20.783833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f236a-0671-4cf0-b626-8a4b4edb6d12 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:20.786101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 129/263] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:20 2022] GET /identity/v3/users/58f3c159b5524f3bb3620f4d8b563ee7 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:20.793294 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f236a-0671-4cf0-b626-8a4b4edb6d12 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:20.864243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b1bfd-3785-4e61-812c-77769aa703f1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:20.912036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:20.942027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a14a-7604-4ad5-b8b9-c281c968e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:20.943047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a14a-7604-4ad5-b8b9-c281c968e731 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:20.943463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a14a-7604-4ad5-b8b9-c281c968e731 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:20.943866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006a14a-7604-4ad5-b8b9-c281c968e731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:20.993496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:21.061052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f236a-0671-4cf0-b626-8a4b4edb6d12 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:21.107390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a987b-f8ea-416e-9a98-148603f4a9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:21.108064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a987b-f8ea-416e-9a98-148603f4a9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:21.109042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a987b-f8ea-416e-9a98-148603f4a9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:21.109339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a987b-f8ea-416e-9a98-148603f4a9d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:21.155908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006a14a-7604-4ad5-b8b9-c281c968e731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:21.158675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006a14a-7604-4ad5-b8b9-c281c968e731 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:21.273339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a987b-f8ea-416e-9a98-148603f4a9d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:21.275920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a987b-f8ea-416e-9a98-148603f4a9d1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:21.404198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 135/264] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:21.410836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a14a-7604-4ad5-b8b9-c281c968e731 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:21.464248 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:21.475713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:21.525693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 130/265] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:21.530681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a987b-f8ea-416e-9a98-148603f4a9d1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:21.640978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006a14a-7604-4ad5-b8b9-c281c968e731 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:21.730962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd323287-2522-4854-a72e-cb0b5a722825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:21.731992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd323287-2522-4854-a72e-cb0b5a722825 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:21.732637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd323287-2522-4854-a72e-cb0b5a722825 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:21.733257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd323287-2522-4854-a72e-cb0b5a722825 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:21.735925 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd323287-2522-4854-a72e-cb0b5a722825 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:21.740830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd323287-2522-4854-a72e-cb0b5a722825 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:21.743561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 136/266] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:21 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:21.749414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd323287-2522-4854-a72e-cb0b5a722825 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:21.772276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a987b-f8ea-416e-9a98-148603f4a9d1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:21.846234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93623803-f40c-4352-a763-ce58c399ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:21.847228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93623803-f40c-4352-a763-ce58c399ea91 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:21.847701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93623803-f40c-4352-a763-ce58c399ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:21.848167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93623803-f40c-4352-a763-ce58c399ea91 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:21.850114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93623803-f40c-4352-a763-ce58c399ea91 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:21.851805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93623803-f40c-4352-a763-ce58c399ea91 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:21.855707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 131/267] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:21 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:21.860408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93623803-f40c-4352-a763-ce58c399ea91 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:21.996511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:21.997702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:22.014355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd323287-2522-4854-a72e-cb0b5a722825 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:22.097438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa060f1-cc8a-46d0-a8f5-40887b88ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:22.097972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa060f1-cc8a-46d0-a8f5-40887b88ab17 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:22.098250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa060f1-cc8a-46d0-a8f5-40887b88ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:22.098527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa060f1-cc8a-46d0-a8f5-40887b88ab17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:22.099272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa060f1-cc8a-46d0-a8f5-40887b88ab17 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=4c832ded083c47aab25b1b28396beea6, user.id=58f3c159b5524f3bb3620f4d8b563ee7) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:22.099585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa060f1-cc8a-46d0-a8f5-40887b88ab17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:22.101080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa060f1-cc8a-46d0-a8f5-40887b88ab17 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:22.119826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 137/268] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:21 2022] GET /identity/v3/role_assignments?user.id=58f3c159b5524f3bb3620f4d8b563ee7&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 608 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:22.121745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d573c8-c3ee-4699-8222-5e026a739e4c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:22.122074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d573c8-c3ee-4699-8222-5e026a739e4c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:22.122302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d573c8-c3ee-4699-8222-5e026a739e4c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:22.128737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 138/269] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:22.138545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b7f64-2796-4774-b18e-19404ed9762d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:22.138923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b7f64-2796-4774-b18e-19404ed9762d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:22.139077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b7f64-2796-4774-b18e-19404ed9762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:22.146782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93623803-f40c-4352-a763-ce58c399ea91 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:22.182002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d80b7f64-2796-4774-b18e-19404ed9762d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:22.183401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d80b7f64-2796-4774-b18e-19404ed9762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:22.215134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5f6e4-5280-43dc-a3ef-cc17f5d3190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:22.215835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f6e4-5280-43dc-a3ef-cc17f5d3190e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:22.216101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f6e4-5280-43dc-a3ef-cc17f5d3190e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:22.216366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f6e4-5280-43dc-a3ef-cc17f5d3190e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:22.217163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5f6e4-5280-43dc-a3ef-cc17f5d3190e None admin] RBAC: Adding query filter params (role.id=c76ef09e05ab4b329ff0580b80c56f59, scope.project.id=4c832ded083c47aab25b1b28396beea6, user.id=58f3c159b5524f3bb3620f4d8b563ee7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:22.217465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5f6e4-5280-43dc-a3ef-cc17f5d3190e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:22.219017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5f6e4-5280-43dc-a3ef-cc17f5d3190e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:22.239163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 132/270] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:21 2022] GET /identity/v3/role_assignments?user.id=58f3c159b5524f3bb3620f4d8b563ee7&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=c76ef09e05ab4b329ff0580b80c56f59 => generated 608 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:22.313040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 139/271] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:22.749174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5f6e4-5280-43dc-a3ef-cc17f5d3190e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:22.817181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762948c-5928-4e04-b1ad-f4105b257e5a None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:22.817625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762948c-5928-4e04-b1ad-f4105b257e5a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:22.817776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762948c-5928-4e04-b1ad-f4105b257e5a None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:22.819125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 140/272] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:22.827892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6edd01-01d6-498d-abbd-8df5398058a0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:22.828180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6edd01-01d6-498d-abbd-8df5398058a0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:22.828596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6edd01-01d6-498d-abbd-8df5398058a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:22.853001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ed6edd01-01d6-498d-abbd-8df5398058a0 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:22.854385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ed6edd01-01d6-498d-abbd-8df5398058a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:22.892287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5f6e4-5280-43dc-a3ef-cc17f5d3190e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:22.910929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:22.948883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adedcd-508d-4304-bdff-fdb9878b43f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:22.949850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adedcd-508d-4304-bdff-fdb9878b43f5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:22.950305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adedcd-508d-4304-bdff-fdb9878b43f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:22.950730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adedcd-508d-4304-bdff-fdb9878b43f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:22.968325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adedcd-508d-4304-bdff-fdb9878b43f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-28adedcd-508d-4304-bdff-fdb9878b43f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:22.976842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:22.977793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:22.978621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 133/273] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:22.981284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e631e6-5b19-4322-b247-0687adae9a64 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:22.981769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e631e6-5b19-4322-b247-0687adae9a64 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:22.982243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e631e6-5b19-4322-b247-0687adae9a64 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:22.984867 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 134/274] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:22.987594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e631e6-5b19-4322-b247-0687adae9a64 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:22.998589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 141/275] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:23.000914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f478b1-53b7-4902-be1a-50445062c815 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:23.001374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f478b1-53b7-4902-be1a-50445062c815 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:23.001932 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f478b1-53b7-4902-be1a-50445062c815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:23.030629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b3f478b1-53b7-4902-be1a-50445062c815 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:23.032633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b3f478b1-53b7-4902-be1a-50445062c815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:23.057421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:23.155278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 142/276] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:23.195576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e631e6-5b19-4322-b247-0687adae9a64 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:23.265396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dec89f-3c07-44f0-82fe-04a579c1527c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:23.266358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec89f-3c07-44f0-82fe-04a579c1527c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:23.266856 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec89f-3c07-44f0-82fe-04a579c1527c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:23.267358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dec89f-3c07-44f0-82fe-04a579c1527c None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:23.268627 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dec89f-3c07-44f0-82fe-04a579c1527c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:23.269173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dec89f-3c07-44f0-82fe-04a579c1527c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:23.271844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dec89f-3c07-44f0-82fe-04a579c1527c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:23.281125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f478b1-53b7-4902-be1a-50445062c815 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:23.290540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 135/277] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:23.298597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dec89f-3c07-44f0-82fe-04a579c1527c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:23.357838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:23.462440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f478b1-53b7-4902-be1a-50445062c815 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:23.507742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dec89f-3c07-44f0-82fe-04a579c1527c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:23.521431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84cb22-5689-44bf-919f-70bf0e4286be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:23.522338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84cb22-5689-44bf-919f-70bf0e4286be None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:23.522795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84cb22-5689-44bf-919f-70bf0e4286be None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:23.523250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84cb22-5689-44bf-919f-70bf0e4286be None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:23.542709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84cb22-5689-44bf-919f-70bf0e4286be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8d84cb22-5689-44bf-919f-70bf0e4286be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:23.552235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:23.554253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:23.555331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 143/278] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:57:23.561143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84cb22-5689-44bf-919f-70bf0e4286be None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:23.581547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89a87-142f-483b-9f62-6990b16314a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:23.582651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89a87-142f-483b-9f62-6990b16314a5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:23.583220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89a87-142f-483b-9f62-6990b16314a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:23.583938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:23.584670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89a87-142f-483b-9f62-6990b16314a5 None admin] PATH_INFO: `/v3/users/6ab2c42c63dc45b88a874856252c7dba` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:23.587956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e89a87-142f-483b-9f62-6990b16314a5 None admin] RBAC: Authorizing `identity:get_user(user_id=6ab2c42c63dc45b88a874856252c7dba)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:23.591523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e89a87-142f-483b-9f62-6990b16314a5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:23.600398 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 136/279] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:23 2022] GET /identity/v3/users/6ab2c42c63dc45b88a874856252c7dba => generated 297 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:23.605296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89a87-142f-483b-9f62-6990b16314a5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:23.743082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84cb22-5689-44bf-919f-70bf0e4286be None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:23.786626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c520d-8cb0-40f6-8f97-4e1c5f27c866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:23.787339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c520d-8cb0-40f6-8f97-4e1c5f27c866 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:23.787802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c520d-8cb0-40f6-8f97-4e1c5f27c866 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:23.788285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c520d-8cb0-40f6-8f97-4e1c5f27c866 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:23.789104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c520d-8cb0-40f6-8f97-4e1c5f27c866 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:23.789531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c520d-8cb0-40f6-8f97-4e1c5f27c866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:23.791265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c520d-8cb0-40f6-8f97-4e1c5f27c866 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:23.798529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:23.804040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 144/280] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:23.805106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c520d-8cb0-40f6-8f97-4e1c5f27c866 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:23.812134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89a87-142f-483b-9f62-6990b16314a5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:23.860471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ef0e0-048c-4edb-8996-bfdeb2b89345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:23.861117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ef0e0-048c-4edb-8996-bfdeb2b89345 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:23.861396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ef0e0-048c-4edb-8996-bfdeb2b89345 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:23.861676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ef0e0-048c-4edb-8996-bfdeb2b89345 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:23.862873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ef0e0-048c-4edb-8996-bfdeb2b89345 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:23.864368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ef0e0-048c-4edb-8996-bfdeb2b89345 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:23.874073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 137/281] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:23 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:23.874073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ef0e0-048c-4edb-8996-bfdeb2b89345 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:23.939356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:23.998657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c520d-8cb0-40f6-8f97-4e1c5f27c866 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:24.061772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ef0e0-048c-4edb-8996-bfdeb2b89345 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:24.062716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf099c35-310c-4506-b448-0e4325f9f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:24.064091 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf099c35-310c-4506-b448-0e4325f9f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:24.064743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf099c35-310c-4506-b448-0e4325f9f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:24.065230 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf099c35-310c-4506-b448-0e4325f9f5e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:24.067302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf099c35-310c-4506-b448-0e4325f9f5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:24.070125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf099c35-310c-4506-b448-0e4325f9f5e3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:24.073982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 145/282] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:57:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:24.075816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf099c35-310c-4506-b448-0e4325f9f5e3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:24.124266 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6e86a-c919-4911-8abf-116c51bb35e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:24.124919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6e86a-c919-4911-8abf-116c51bb35e3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:24.125112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6e86a-c919-4911-8abf-116c51bb35e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:24.125369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6e86a-c919-4911-8abf-116c51bb35e3 None admin] PATH_INFO: `/v3/users/aa9b89e4f1424672b1fdebe4827f9bc8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:24.154395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6e86a-c919-4911-8abf-116c51bb35e3 None admin] RBAC: Authorizing `identity:get_user(user_id=aa9b89e4f1424672b1fdebe4827f9bc8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:24.156334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6e86a-c919-4911-8abf-116c51bb35e3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:24.158236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 138/283] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:23 2022] GET /identity/v3/users/aa9b89e4f1424672b1fdebe4827f9bc8 => generated 293 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:24.159152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6e86a-c919-4911-8abf-116c51bb35e3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:24.190649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:24.264926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf099c35-310c-4506-b448-0e4325f9f5e3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:24.271731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6e86a-c919-4911-8abf-116c51bb35e3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:24.311707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917b053-ec76-40e6-9bf3-c3823b9aa06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:24.312851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917b053-ec76-40e6-9bf3-c3823b9aa06f None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:24.313159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a0161-d290-491a-9181-d976ca86cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:24.313342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917b053-ec76-40e6-9bf3-c3823b9aa06f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:24.313611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917b053-ec76-40e6-9bf3-c3823b9aa06f None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6/users/6ab2c42c63dc45b88a874856252c7dba/roles/57523b6804424d1782f8e7df8974669f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:24.313950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a0161-d290-491a-9181-d976ca86cde1 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:24.314295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a0161-d290-491a-9181-d976ca86cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:24.314635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a0161-d290-491a-9181-d976ca86cde1 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:24.315522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a0161-d290-491a-9181-d976ca86cde1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:24.316121 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917b053-ec76-40e6-9bf3-c3823b9aa06f None admin] RBAC: Authorizing `identity:create_grant(project_id=4c832ded083c47aab25b1b28396beea6, user_id=6ab2c42c63dc45b88a874856252c7dba, role_id=57523b6804424d1782f8e7df8974669f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:24.317128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a0161-d290-491a-9181-d976ca86cde1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:24.317875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917b053-ec76-40e6-9bf3-c3823b9aa06f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:24.428553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:24.434805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 146/284] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:57:24 2022] PUT /identity/v3/projects/4c832ded083c47aab25b1b28396beea6/users/6ab2c42c63dc45b88a874856252c7dba/roles/57523b6804424d1782f8e7df8974669f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:57:24.445454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1021e-a782-4db2-9d28-113e042ac747 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:24.445454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1021e-a782-4db2-9d28-113e042ac747 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:24.445454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1021e-a782-4db2-9d28-113e042ac747 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:24.445454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 147/285] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:24.445454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1021e-a782-4db2-9d28-113e042ac747 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:24.510165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 139/286] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:57:24 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:57:24.513647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb03aee-fb7a-49f0-a18b-d15cea96571f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:24.514568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb03aee-fb7a-49f0-a18b-d15cea96571f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:24.515323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb03aee-fb7a-49f0-a18b-d15cea96571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:24.553102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cbb03aee-fb7a-49f0-a18b-d15cea96571f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:24.556141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cbb03aee-fb7a-49f0-a18b-d15cea96571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:24.650267 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1021e-a782-4db2-9d28-113e042ac747 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:24.700634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477e63-3b26-4c98-be01-8198e6ab4ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:24.701307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477e63-3b26-4c98-be01-8198e6ab4ccc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:24.701579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477e63-3b26-4c98-be01-8198e6ab4ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:24.701858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477e63-3b26-4c98-be01-8198e6ab4ccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:24.702660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1477e63-3b26-4c98-be01-8198e6ab4ccc None admin] RBAC: Adding query filter params (role.id=4a2e97979a4c4cd796f797f81fff095a, user.id=aa9b89e4f1424672b1fdebe4827f9bc8, scope.system=all) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:24.702978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1477e63-3b26-4c98-be01-8198e6ab4ccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:24.704616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1477e63-3b26-4c98-be01-8198e6ab4ccc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:24.712495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 148/287] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Sep 1 11:57:24 2022] GET /identity/v3/role_assignments?user.id=aa9b89e4f1424672b1fdebe4827f9bc8&scope.system=all&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:24.720304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 140/288] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:25.292390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477e63-3b26-4c98-be01-8198e6ab4ccc None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:25.435774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:25.521880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477e63-3b26-4c98-be01-8198e6ab4ccc None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:25.594057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aae89d-00c5-4450-aa6a-06bd188b13b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:25.595040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aae89d-00c5-4450-aa6a-06bd188b13b1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:25.595545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aae89d-00c5-4450-aa6a-06bd188b13b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:25.595935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aae89d-00c5-4450-aa6a-06bd188b13b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:25.621838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aae89d-00c5-4450-aa6a-06bd188b13b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-d6aae89d-00c5-4450-aa6a-06bd188b13b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:25.632673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:25.634381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:25.637553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 149/289] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:25.645398 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb03aee-fb7a-49f0-a18b-d15cea96571f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:25.662610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:25.809371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb03aee-fb7a-49f0-a18b-d15cea96571f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:25.885134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9cace-85e5-44a8-922d-8a17e9706bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:25.887310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cace-85e5-44a8-922d-8a17e9706bbe None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:25.888072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cace-85e5-44a8-922d-8a17e9706bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:25.888879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cace-85e5-44a8-922d-8a17e9706bbe None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:25.890337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9cace-85e5-44a8-922d-8a17e9706bbe None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:25.891117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9cace-85e5-44a8-922d-8a17e9706bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:25.894115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9cace-85e5-44a8-922d-8a17e9706bbe None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:25.918610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 141/290] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:25.924544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aae89d-00c5-4450-aa6a-06bd188b13b1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:26.048708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aae89d-00c5-4450-aa6a-06bd188b13b1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:26.073625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:26.096926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4137c60-686d-4f55-8e5c-9cdeb640031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:26.097666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137c60-686d-4f55-8e5c-9cdeb640031e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:26.098012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137c60-686d-4f55-8e5c-9cdeb640031e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:26.098291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137c60-686d-4f55-8e5c-9cdeb640031e None admin] PATH_INFO: `/v3/users/80b9488c846c4c338d7ac0e0fd802632` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:26.105561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4137c60-686d-4f55-8e5c-9cdeb640031e None admin] RBAC: Authorizing `identity:get_user(user_id=80b9488c846c4c338d7ac0e0fd802632)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:26.107057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4137c60-686d-4f55-8e5c-9cdeb640031e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:26.108806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 150/291] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:25 2022] GET /identity/v3/users/80b9488c846c4c338d7ac0e0fd802632 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:26.115541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9cace-85e5-44a8-922d-8a17e9706bbe None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:26.263778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:26.308748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9cace-85e5-44a8-922d-8a17e9706bbe None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:26.361030 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f1456-55be-4811-839e-4d03430f033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:26.361729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f1456-55be-4811-839e-4d03430f033d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:26.362019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f1456-55be-4811-839e-4d03430f033d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:26.362319 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f1456-55be-4811-839e-4d03430f033d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:26.469230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f1456-55be-4811-839e-4d03430f033d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:26.470730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f1456-55be-4811-839e-4d03430f033d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:26.573005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:26.621728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 142/292] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:26.627571 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4137c60-686d-4f55-8e5c-9cdeb640031e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:26.788844 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4137c60-686d-4f55-8e5c-9cdeb640031e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:26.832103 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746c9e2-4d0c-4e60-afcb-241be954defc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:26.832691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c9e2-4d0c-4e60-afcb-241be954defc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:26.832974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c9e2-4d0c-4e60-afcb-241be954defc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:26.833251 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c9e2-4d0c-4e60-afcb-241be954defc None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:26.837023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746c9e2-4d0c-4e60-afcb-241be954defc None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:26.838502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746c9e2-4d0c-4e60-afcb-241be954defc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:26.840673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 151/293] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:26 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:26.846515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f1456-55be-4811-839e-4d03430f033d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:27.016416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f1456-55be-4811-839e-4d03430f033d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:27.066211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8daf01-4cb1-4127-bc8f-3242c271f419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:27.066832 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8daf01-4cb1-4127-bc8f-3242c271f419 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:27.067086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8daf01-4cb1-4127-bc8f-3242c271f419 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:27.067367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8daf01-4cb1-4127-bc8f-3242c271f419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:27.068099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8daf01-4cb1-4127-bc8f-3242c271f419 None admin] RBAC: Adding query filter params (role.id=4a2e97979a4c4cd796f797f81fff095a, scope.project.id=4c832ded083c47aab25b1b28396beea6, user.id=80b9488c846c4c338d7ac0e0fd802632) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:27.068429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8daf01-4cb1-4127-bc8f-3242c271f419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:27.069871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8daf01-4cb1-4127-bc8f-3242c271f419 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:27.081489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 143/294] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:26 2022] GET /identity/v3/role_assignments?user.id=80b9488c846c4c338d7ac0e0fd802632&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:27.258843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7d9b-7afe-4769-a23c-e938151545ae None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:27.259299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7d9b-7afe-4769-a23c-e938151545ae None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:27.259520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7d9b-7afe-4769-a23c-e938151545ae None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:27.261320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 152/295] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:27.270573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bca65-39b8-4be2-b4c2-6267a65b795e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:27.270949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bca65-39b8-4be2-b4c2-6267a65b795e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:27.271161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bca65-39b8-4be2-b4c2-6267a65b795e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:27.311655 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-225bca65-39b8-4be2-b4c2-6267a65b795e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:27.313785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-225bca65-39b8-4be2-b4c2-6267a65b795e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:27.386053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:27.394415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6dfd5-a553-4774-856b-932b2848bdec None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:27.394879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6dfd5-a553-4774-856b-932b2848bdec None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:27.395354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6dfd5-a553-4774-856b-932b2848bdec None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:27.399426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 153/296] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:27.408559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4125c-2518-4488-8a41-dc668f108d01 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:27.409165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4125c-2518-4488-8a41-dc668f108d01 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:27.409671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4125c-2518-4488-8a41-dc668f108d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:27.436582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-69a4125c-2518-4488-8a41-dc668f108d01 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:27.438244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-69a4125c-2518-4488-8a41-dc668f108d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:27.473671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 144/297] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:27.509714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:27.539848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 154/298] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:27.732716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499ab9-abfb-4eef-93a9-53d2d7fa4f26 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:27.733736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499ab9-abfb-4eef-93a9-53d2d7fa4f26 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:27.734520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499ab9-abfb-4eef-93a9-53d2d7fa4f26 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:27.737637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 145/299] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:27.744503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440098b9-1509-4f88-b57a-0aca8084e500 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:27.745946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440098b9-1509-4f88-b57a-0aca8084e500 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:27.746089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440098b9-1509-4f88-b57a-0aca8084e500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:27.778127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-440098b9-1509-4f88-b57a-0aca8084e500 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:27.780641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-440098b9-1509-4f88-b57a-0aca8084e500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:27.887519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a499ab9-abfb-4eef-93a9-53d2d7fa4f26 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:27.913880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 155/300] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:27.998536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a499ab9-abfb-4eef-93a9-53d2d7fa4f26 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:28.036626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff1fb7-1a36-4551-b0ea-8b8db1ceed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:28.037874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff1fb7-1a36-4551-b0ea-8b8db1ceed94 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.038430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff1fb7-1a36-4551-b0ea-8b8db1ceed94 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.038991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff1fb7-1a36-4551-b0ea-8b8db1ceed94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.051723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff1fb7-1a36-4551-b0ea-8b8db1ceed94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-afff1fb7-1a36-4551-b0ea-8b8db1ceed94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:28.057195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:28.058189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:28.058992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:28.061591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440098b9-1509-4f88-b57a-0aca8084e500 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:28.062066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 146/301] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:28.072255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff1fb7-1a36-4551-b0ea-8b8db1ceed94 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:28.119372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:28.181959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440098b9-1509-4f88-b57a-0aca8084e500 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:28.201918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:28.211408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff1fb7-1a36-4551-b0ea-8b8db1ceed94 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:28.221352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56709a34-907c-4033-a9f6-a23b6a56ef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:28.222147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56709a34-907c-4033-a9f6-a23b6a56ef14 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.222550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56709a34-907c-4033-a9f6-a23b6a56ef14 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.222930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56709a34-907c-4033-a9f6-a23b6a56ef14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.235609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56709a34-907c-4033-a9f6-a23b6a56ef14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-56709a34-907c-4033-a9f6-a23b6a56ef14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:28.240484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:28.244677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 156/302] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:28.246332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef5108-34f2-4fe2-bdc3-28b7187abaf7 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.247107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef5108-34f2-4fe2-bdc3-28b7187abaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.247107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef5108-34f2-4fe2-bdc3-28b7187abaf7 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.247107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 157/303] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:28.247107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef5108-34f2-4fe2-bdc3-28b7187abaf7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:28.257416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453eec5-12ae-403f-ae9e-04d26df1062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:28.258242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453eec5-12ae-403f-ae9e-04d26df1062d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.258573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453eec5-12ae-403f-ae9e-04d26df1062d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.258889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453eec5-12ae-403f-ae9e-04d26df1062d None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.259603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453eec5-12ae-403f-ae9e-04d26df1062d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:28.259950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453eec5-12ae-403f-ae9e-04d26df1062d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:28.261618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453eec5-12ae-403f-ae9e-04d26df1062d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:28.270380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 147/304] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:28.271297 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453eec5-12ae-403f-ae9e-04d26df1062d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:28.362719 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef5108-34f2-4fe2-bdc3-28b7187abaf7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:28.375935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:28.391882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453eec5-12ae-403f-ae9e-04d26df1062d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:28.410851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc931a-e729-47db-9971-7362f8f61be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:28.411909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc931a-e729-47db-9971-7362f8f61be0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.412403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc931a-e729-47db-9971-7362f8f61be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.412901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc931a-e729-47db-9971-7362f8f61be0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.427358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8278e-293f-4495-a1cc-867e1faf0486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:28.428096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8278e-293f-4495-a1cc-867e1faf0486 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.428471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8278e-293f-4495-a1cc-867e1faf0486 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.428830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8278e-293f-4495-a1cc-867e1faf0486 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.429656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8278e-293f-4495-a1cc-867e1faf0486 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:28.429976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8278e-293f-4495-a1cc-867e1faf0486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:28.431440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8278e-293f-4495-a1cc-867e1faf0486 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:28.431852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc931a-e729-47db-9971-7362f8f61be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:28.442089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 148/305] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6dfc931a-e729-47db-9971-7362f8f61be0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:28.442404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:28.443241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:28.444094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:28.444962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0487-5bc9-43c0-b546-53aaa7bd6c68 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.444962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0487-5bc9-43c0-b546-53aaa7bd6c68 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.444962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0487-5bc9-43c0-b546-53aaa7bd6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.445187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 158/306] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:28.445803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc931a-e729-47db-9971-7362f8f61be0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:28.465667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-29fe0487-5bc9-43c0-b546-53aaa7bd6c68 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:28.466862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-29fe0487-5bc9-43c0-b546-53aaa7bd6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:28.514027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:28.536783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 149/307] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:28.538564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe0487-5bc9-43c0-b546-53aaa7bd6c68 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:28.602587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc931a-e729-47db-9971-7362f8f61be0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:28.655545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:28.659645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735837-b8fb-47a2-b34b-f3b53edb8343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:28.660661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735837-b8fb-47a2-b34b-f3b53edb8343 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.661090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735837-b8fb-47a2-b34b-f3b53edb8343 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.661659 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735837-b8fb-47a2-b34b-f3b53edb8343 None admin] PATH_INFO: `/v3/users/15e1e3c235c44c3793aa95459dca8085` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.679636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c735837-b8fb-47a2-b34b-f3b53edb8343 None admin] RBAC: Authorizing `identity:get_user(user_id=15e1e3c235c44c3793aa95459dca8085)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:28.685293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c735837-b8fb-47a2-b34b-f3b53edb8343 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:28.685503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe0487-5bc9-43c0-b546-53aaa7bd6c68 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:28.691365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 159/308] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:28 2022] GET /identity/v3/users/15e1e3c235c44c3793aa95459dca8085 => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:28.691365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735837-b8fb-47a2-b34b-f3b53edb8343 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:28.739225 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974a67b-79a3-44ed-85e8-862e0145a902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:28.740619 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974a67b-79a3-44ed-85e8-862e0145a902 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.741080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974a67b-79a3-44ed-85e8-862e0145a902 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.741675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974a67b-79a3-44ed-85e8-862e0145a902 None admin] PATH_INFO: `/v3/users/6ab2c42c63dc45b88a874856252c7dba` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.743388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974a67b-79a3-44ed-85e8-862e0145a902 None admin] RBAC: Authorizing `identity:get_user(user_id=6ab2c42c63dc45b88a874856252c7dba)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:28.746051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974a67b-79a3-44ed-85e8-862e0145a902 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:28.748934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 150/309] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:28 2022] GET /identity/v3/users/6ab2c42c63dc45b88a874856252c7dba => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:28.750099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974a67b-79a3-44ed-85e8-862e0145a902 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:28.833106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:28.842304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735837-b8fb-47a2-b34b-f3b53edb8343 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:28.884191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974a67b-79a3-44ed-85e8-862e0145a902 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:28.895024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476dd0-4ff1-43b1-9604-9ada2b3682a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:28.895964 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476dd0-4ff1-43b1-9604-9ada2b3682a8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.896430 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476dd0-4ff1-43b1-9604-9ada2b3682a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.896814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476dd0-4ff1-43b1-9604-9ada2b3682a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.897601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476dd0-4ff1-43b1-9604-9ada2b3682a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:28.898082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476dd0-4ff1-43b1-9604-9ada2b3682a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:28.899924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476dd0-4ff1-43b1-9604-9ada2b3682a8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:28.910420 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 160/310] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:28.911029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476dd0-4ff1-43b1-9604-9ada2b3682a8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:28.941288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c17a7d-1459-49b0-b8aa-08f41b7123e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:28.942104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c17a7d-1459-49b0-b8aa-08f41b7123e0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:28.942289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c17a7d-1459-49b0-b8aa-08f41b7123e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:28.942435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c17a7d-1459-49b0-b8aa-08f41b7123e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:28.943150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c17a7d-1459-49b0-b8aa-08f41b7123e0 None admin] RBAC: Adding query filter params (role.id=57523b6804424d1782f8e7df8974669f, user.id=15e1e3c235c44c3793aa95459dca8085, scope.system=all) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:28.943451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c17a7d-1459-49b0-b8aa-08f41b7123e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:28.944950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c17a7d-1459-49b0-b8aa-08f41b7123e0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:28.960971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 151/311] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Sep 1 11:57:28 2022] GET /identity/v3/role_assignments?user.id=15e1e3c235c44c3793aa95459dca8085&scope.system=all&role.id=57523b6804424d1782f8e7df8974669f => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:28.960971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c17a7d-1459-49b0-b8aa-08f41b7123e0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:28.974660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:29.064031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476dd0-4ff1-43b1-9604-9ada2b3682a8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:29.116374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fcb12-9f27-4a50-a17e-dc7b0f0f8651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:29.117198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fcb12-9f27-4a50-a17e-dc7b0f0f8651 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:29.117922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fcb12-9f27-4a50-a17e-dc7b0f0f8651 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:29.117922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fcb12-9f27-4a50-a17e-dc7b0f0f8651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:29.132097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c17a7d-1459-49b0-b8aa-08f41b7123e0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:29.149533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:29.174323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd800-9c45-48de-9b56-c64be90709c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:29.174946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd800-9c45-48de-9b56-c64be90709c4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:29.175227 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd800-9c45-48de-9b56-c64be90709c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:29.175498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd800-9c45-48de-9b56-c64be90709c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:29.176675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacd800-9c45-48de-9b56-c64be90709c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:29.178150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacd800-9c45-48de-9b56-c64be90709c4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:29.179770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 152/312] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:57:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:29.179770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd800-9c45-48de-9b56-c64be90709c4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:29.204351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fcb12-9f27-4a50-a17e-dc7b0f0f8651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:29.206269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fcb12-9f27-4a50-a17e-dc7b0f0f8651 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:29.276617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:29.308172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd800-9c45-48de-9b56-c64be90709c4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:29.356902 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54167140-4135-44c7-84a5-582472283df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:29.357615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54167140-4135-44c7-84a5-582472283df2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:29.357895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54167140-4135-44c7-84a5-582472283df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:29.358171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54167140-4135-44c7-84a5-582472283df2 None admin] PATH_INFO: `/v3/users/aa9b89e4f1424672b1fdebe4827f9bc8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:29.359392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54167140-4135-44c7-84a5-582472283df2 None admin] RBAC: Authorizing `identity:get_user(user_id=aa9b89e4f1424672b1fdebe4827f9bc8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:29.360927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54167140-4135-44c7-84a5-582472283df2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:29.365799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 161/313] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:29.365799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fcb12-9f27-4a50-a17e-dc7b0f0f8651 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:29.367799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 153/314] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:29 2022] GET /identity/v3/users/aa9b89e4f1424672b1fdebe4827f9bc8 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:29.368698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54167140-4135-44c7-84a5-582472283df2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:29.454250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:29.502849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54167140-4135-44c7-84a5-582472283df2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:29.521791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fcb12-9f27-4a50-a17e-dc7b0f0f8651 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:29.548584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f93b0-5d7f-4e5a-8f16-07d94462c875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:29.549870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f93b0-5d7f-4e5a-8f16-07d94462c875 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:29.550279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f93b0-5d7f-4e5a-8f16-07d94462c875 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:29.550736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f93b0-5d7f-4e5a-8f16-07d94462c875 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:29.552251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f93b0-5d7f-4e5a-8f16-07d94462c875 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:29.554229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f93b0-5d7f-4e5a-8f16-07d94462c875 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:29.556742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 154/315] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:29 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:29.562721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aba80-937b-459d-b49b-7ac718ae0e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:29.563351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aba80-937b-459d-b49b-7ac718ae0e75 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:29.563613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f93b0-5d7f-4e5a-8f16-07d94462c875 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:29.563768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aba80-937b-459d-b49b-7ac718ae0e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:29.563914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aba80-937b-459d-b49b-7ac718ae0e75 None admin] PATH_INFO: `/v3/groups` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:29.564716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51aba80-937b-459d-b49b-7ac718ae0e75 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:29.566115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51aba80-937b-459d-b49b-7ac718ae0e75 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:29.581496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:29.658262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 162/316] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Sep 1 11:57:29 2022] POST /identity/v3/groups => generated 229 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:57:29.660073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aba80-937b-459d-b49b-7ac718ae0e75 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:29.714357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f93b0-5d7f-4e5a-8f16-07d94462c875 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:29.794511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e4f08-8f41-4d0d-9d19-de6531d1830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:29.796257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4f08-8f41-4d0d-9d19-de6531d1830d None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:29.796257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4f08-8f41-4d0d-9d19-de6531d1830d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:29.796729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4f08-8f41-4d0d-9d19-de6531d1830d None admin] PATH_INFO: `/v3/system/users/aa9b89e4f1424672b1fdebe4827f9bc8/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:29.799686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e4f08-8f41-4d0d-9d19-de6531d1830d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aa9b89e4f1424672b1fdebe4827f9bc8, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:29.802459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e4f08-8f41-4d0d-9d19-de6531d1830d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:29.852395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aba80-937b-459d-b49b-7ac718ae0e75 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:29.892525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:29.916257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d271-f4c3-432a-bbba-1cb0fadd2524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:29.916952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d271-f4c3-432a-bbba-1cb0fadd2524 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:29.917233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d271-f4c3-432a-bbba-1cb0fadd2524 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:29.917513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d271-f4c3-432a-bbba-1cb0fadd2524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:29.918338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d271-f4c3-432a-bbba-1cb0fadd2524 None admin] RBAC: Adding query filter params (role.id=57523b6804424d1782f8e7df8974669f, scope.project.id=4c832ded083c47aab25b1b28396beea6, user.id=6ab2c42c63dc45b88a874856252c7dba) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:29.918651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d271-f4c3-432a-bbba-1cb0fadd2524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:29.920111 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d271-f4c3-432a-bbba-1cb0fadd2524 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:29.928835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 163/317] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:57:29 2022] GET /identity/v3/role_assignments?user.id=6ab2c42c63dc45b88a874856252c7dba&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=57523b6804424d1782f8e7df8974669f => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:29.929379 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 155/318] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Sep 1 11:57:29 2022] PUT /identity/v3/system/users/aa9b89e4f1424672b1fdebe4827f9bc8/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:57:30.921817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826689e5-791a-4d8c-9ed2-0a612ba58a56 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:30.922528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826689e5-791a-4d8c-9ed2-0a612ba58a56 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:30.922528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826689e5-791a-4d8c-9ed2-0a612ba58a56 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:30.924362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 164/319] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:30.930193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eba5e-2ec6-45b7-ad83-bf4dde49802e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:30.930903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eba5e-2ec6-45b7-ad83-bf4dde49802e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:30.930903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eba5e-2ec6-45b7-ad83-bf4dde49802e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:30.950771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-218eba5e-2ec6-45b7-ad83-bf4dde49802e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:30.951869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-218eba5e-2ec6-45b7-ad83-bf4dde49802e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:31.031558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 156/320] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:31.300019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826689e5-791a-4d8c-9ed2-0a612ba58a56 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:31.421031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826689e5-791a-4d8c-9ed2-0a612ba58a56 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:31.461486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe4461-3ea4-4fd6-aa96-3985c457b243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:31.462292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe4461-3ea4-4fd6-aa96-3985c457b243 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:31.462689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe4461-3ea4-4fd6-aa96-3985c457b243 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:31.463137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe4461-3ea4-4fd6-aa96-3985c457b243 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:31.476331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe4461-3ea4-4fd6-aa96-3985c457b243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-71fe4461-3ea4-4fd6-aa96-3985c457b243 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:31.482000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:31.483703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:31.485884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 165/321] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:31.491622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eba5e-2ec6-45b7-ad83-bf4dde49802e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:31.503355 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:31.618984 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eba5e-2ec6-45b7-ad83-bf4dde49802e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:31.692687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6048d-95f9-48b5-8ec3-3ecf8de2a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:31.693779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6048d-95f9-48b5-8ec3-3ecf8de2a187 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:31.694268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6048d-95f9-48b5-8ec3-3ecf8de2a187 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:31.694678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6048d-95f9-48b5-8ec3-3ecf8de2a187 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:31.695938 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6048d-95f9-48b5-8ec3-3ecf8de2a187 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:31.696521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6048d-95f9-48b5-8ec3-3ecf8de2a187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:31.699262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6048d-95f9-48b5-8ec3-3ecf8de2a187 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:31.720409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 157/322] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:31.725039 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe4461-3ea4-4fd6-aa96-3985c457b243 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:31.804646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753a008-6541-4bb5-b3c5-eb9f7869b0dd None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:31.805047 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753a008-6541-4bb5-b3c5-eb9f7869b0dd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:31.805206 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753a008-6541-4bb5-b3c5-eb9f7869b0dd None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:31.806954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 158/323] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:31.812454 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fa7af-db04-4cde-9d28-78b5dbf609f3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:31.812711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fa7af-db04-4cde-9d28-78b5dbf609f3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:31.812856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:31.812996 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fa7af-db04-4cde-9d28-78b5dbf609f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:31.832095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-175fa7af-db04-4cde-9d28-78b5dbf609f3 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:31.833344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-175fa7af-db04-4cde-9d28-78b5dbf609f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:31.916009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe4461-3ea4-4fd6-aa96-3985c457b243 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:31.949718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:31.960359 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 159/324] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:31.978488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d775e-c39b-4c3e-bf98-f482bd36a1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:31.980092 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d775e-c39b-4c3e-bf98-f482bd36a1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:31.980631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d775e-c39b-4c3e-bf98-f482bd36a1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:31.981122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d775e-c39b-4c3e-bf98-f482bd36a1b9 None admin] PATH_INFO: `/v3/users/15e1e3c235c44c3793aa95459dca8085` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:31.983113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d775e-c39b-4c3e-bf98-f482bd36a1b9 None admin] RBAC: Authorizing `identity:get_user(user_id=15e1e3c235c44c3793aa95459dca8085)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:31.985944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d775e-c39b-4c3e-bf98-f482bd36a1b9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:31.989345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 166/325] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:31 2022] GET /identity/v3/users/15e1e3c235c44c3793aa95459dca8085 => generated 293 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:31.995383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fa7af-db04-4cde-9d28-78b5dbf609f3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:32.151269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fa7af-db04-4cde-9d28-78b5dbf609f3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:32.211562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26d132-dc4e-4ea2-bb77-893bfb57362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:32.212665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d132-dc4e-4ea2-bb77-893bfb57362b None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:32.213169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d132-dc4e-4ea2-bb77-893bfb57362b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:32.213743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d132-dc4e-4ea2-bb77-893bfb57362b None admin] PATH_INFO: `/v3/system/users/15e1e3c235c44c3793aa95459dca8085/roles/57523b6804424d1782f8e7df8974669f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:32.216325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26d132-dc4e-4ea2-bb77-893bfb57362b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=15e1e3c235c44c3793aa95459dca8085, role_id=57523b6804424d1782f8e7df8974669f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:32.218739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26d132-dc4e-4ea2-bb77-893bfb57362b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:32.235754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d775e-c39b-4c3e-bf98-f482bd36a1b9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:32.339547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d775e-c39b-4c3e-bf98-f482bd36a1b9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:32.340426 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 160/326] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Sep 1 11:57:31 2022] PUT /identity/v3/system/users/15e1e3c235c44c3793aa95459dca8085/roles/57523b6804424d1782f8e7df8974669f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 11:57:32.364867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:32.394621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e2c7c-628c-4b0f-a843-5e2357856d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:32.395288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e2c7c-628c-4b0f-a843-5e2357856d0e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:32.395633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e2c7c-628c-4b0f-a843-5e2357856d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:32.395878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e2c7c-628c-4b0f-a843-5e2357856d0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:32.397139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e2c7c-628c-4b0f-a843-5e2357856d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:32.398654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e2c7c-628c-4b0f-a843-5e2357856d0e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:32.404905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 167/327] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:57:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:32.406127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26d132-dc4e-4ea2-bb77-893bfb57362b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:32.483824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:32.533736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26d132-dc4e-4ea2-bb77-893bfb57362b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:32.575329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0287d9-caf5-413d-b52c-0ed9a8c4ad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:32.575953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0287d9-caf5-413d-b52c-0ed9a8c4ad4e None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:32.576264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0287d9-caf5-413d-b52c-0ed9a8c4ad4e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:32.576526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0287d9-caf5-413d-b52c-0ed9a8c4ad4e None admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:32.577250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0287d9-caf5-413d-b52c-0ed9a8c4ad4e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:32.578699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0287d9-caf5-413d-b52c-0ed9a8c4ad4e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:32.708610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 161/328] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Sep 1 11:57:32 2022] POST /identity/v3/groups => generated 226 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 11:57:33.054191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880cfc-59bc-4e61-ac10-c1a128bb0978 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:33.054730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880cfc-59bc-4e61-ac10-c1a128bb0978 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:33.055154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880cfc-59bc-4e61-ac10-c1a128bb0978 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:33.058640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 168/329] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:33.067878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08096be4-1b78-45dd-94ed-ab88bf11eb77 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:33.068481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08096be4-1b78-45dd-94ed-ab88bf11eb77 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:33.068946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08096be4-1b78-45dd-94ed-ab88bf11eb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:33.101816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-08096be4-1b78-45dd-94ed-ab88bf11eb77 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:33.103734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-08096be4-1b78-45dd-94ed-ab88bf11eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:33.240827 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 162/330] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:33.577541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2880cfc-59bc-4e61-ac10-c1a128bb0978 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:33.815413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2880cfc-59bc-4e61-ac10-c1a128bb0978 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:33.889514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8fbc6-1eab-4675-aa11-5bd6a8c6eceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:33.890579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8fbc6-1eab-4675-aa11-5bd6a8c6eceb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:33.891073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8fbc6-1eab-4675-aa11-5bd6a8c6eceb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:33.891563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8fbc6-1eab-4675-aa11-5bd6a8c6eceb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:33.916658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8fbc6-1eab-4675-aa11-5bd6a8c6eceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-46a8fbc6-1eab-4675-aa11-5bd6a8c6eceb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:33.929068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:33.930047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:33.930815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:33.931412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 169/331] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:33.940226 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08096be4-1b78-45dd-94ed-ab88bf11eb77 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:34.051042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:34.145413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08096be4-1b78-45dd-94ed-ab88bf11eb77 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:34.229723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48680fc-6e2d-4685-8695-40336cb0b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:34.230793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48680fc-6e2d-4685-8695-40336cb0b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:34.231271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48680fc-6e2d-4685-8695-40336cb0b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:34.231770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48680fc-6e2d-4685-8695-40336cb0b8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:34.233042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48680fc-6e2d-4685-8695-40336cb0b8a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:34.233691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48680fc-6e2d-4685-8695-40336cb0b8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:34.236337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48680fc-6e2d-4685-8695-40336cb0b8a7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:34.255220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 163/332] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:34.261868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8fbc6-1eab-4675-aa11-5bd6a8c6eceb None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:34.361158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19bc1e-407c-4f47-957d-714bffea5b14 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:34.361811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19bc1e-407c-4f47-957d-714bffea5b14 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:34.362296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19bc1e-407c-4f47-957d-714bffea5b14 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:34.364258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 164/333] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:34.370728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152fef8-8ede-49e0-9152-1fc88c6f814a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:34.371361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152fef8-8ede-49e0-9152-1fc88c6f814a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:34.371904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152fef8-8ede-49e0-9152-1fc88c6f814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:34.374151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:34.421152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6152fef8-8ede-49e0-9152-1fc88c6f814a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:34.423019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6152fef8-8ede-49e0-9152-1fc88c6f814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:34.510992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8fbc6-1eab-4675-aa11-5bd6a8c6eceb None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:34.607690 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ac09d-e966-4129-852f-f4e5a511a414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:34.609136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ac09d-e966-4129-852f-f4e5a511a414 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:34.609879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ac09d-e966-4129-852f-f4e5a511a414 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:34.610567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ac09d-e966-4129-852f-f4e5a511a414 None admin] PATH_INFO: `/v3/users/aa9b89e4f1424672b1fdebe4827f9bc8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:34.615786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ac09d-e966-4129-852f-f4e5a511a414 None admin] RBAC: Authorizing `identity:get_user(user_id=aa9b89e4f1424672b1fdebe4827f9bc8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:34.618637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ac09d-e966-4129-852f-f4e5a511a414 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:34.627450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 165/334] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:34.628569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 170/335] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:34 2022] GET /identity/v3/users/aa9b89e4f1424672b1fdebe4827f9bc8 => generated 293 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:34.634950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152fef8-8ede-49e0-9152-1fc88c6f814a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:34.729516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:34.850524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152fef8-8ede-49e0-9152-1fc88c6f814a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:34.925141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347bb11-52ee-4bb2-bbdd-2547746a9c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:34.926204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347bb11-52ee-4bb2-bbdd-2547746a9c5f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:34.926704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347bb11-52ee-4bb2-bbdd-2547746a9c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:34.927185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347bb11-52ee-4bb2-bbdd-2547746a9c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:34.928635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347bb11-52ee-4bb2-bbdd-2547746a9c5f None admin] RBAC: Adding query filter params (role.id=4a2e97979a4c4cd796f797f81fff095a, user.id=aa9b89e4f1424672b1fdebe4827f9bc8, scope.system=all) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:34.929205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347bb11-52ee-4bb2-bbdd-2547746a9c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:34.932649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347bb11-52ee-4bb2-bbdd-2547746a9c5f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:34.965441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 166/336] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Sep 1 11:57:34 2022] GET /identity/v3/role_assignments?user.id=aa9b89e4f1424672b1fdebe4827f9bc8&scope.system=all&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 510 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:34.976428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ac09d-e966-4129-852f-f4e5a511a414 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:35.225982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ac09d-e966-4129-852f-f4e5a511a414 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:35.256621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:35.309159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e45e6f-13f6-4191-a1e9-b4324da53400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:35.310130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e45e6f-13f6-4191-a1e9-b4324da53400 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:35.310554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e45e6f-13f6-4191-a1e9-b4324da53400 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:35.310986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e45e6f-13f6-4191-a1e9-b4324da53400 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:35.334056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e45e6f-13f6-4191-a1e9-b4324da53400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e5e45e6f-13f6-4191-a1e9-b4324da53400 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:35.349083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:35.350028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 11:57:35.350822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:35.351899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 171/337] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:57:35.361972 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347bb11-52ee-4bb2-bbdd-2547746a9c5f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:35.488195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e322be-36ca-4a4e-aad3-3bb06640ef10 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:35.488729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e322be-36ca-4a4e-aad3-3bb06640ef10 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:35.489229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e322be-36ca-4a4e-aad3-3bb06640ef10 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:35.491803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 172/338] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:35.503430 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685583-95f7-452b-b307-7a6ff4e1920a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:35.503927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685583-95f7-452b-b307-7a6ff4e1920a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:35.504475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685583-95f7-452b-b307-7a6ff4e1920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:35.555820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5d685583-95f7-452b-b307-7a6ff4e1920a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:35.558066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5d685583-95f7-452b-b307-7a6ff4e1920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:35.596859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347bb11-52ee-4bb2-bbdd-2547746a9c5f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:35.615167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:35.677347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b28bef-da56-4a29-83f5-86655e85d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:35.678382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b28bef-da56-4a29-83f5-86655e85d703 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:35.678836 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b28bef-da56-4a29-83f5-86655e85d703 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:35.679286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b28bef-da56-4a29-83f5-86655e85d703 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:35.680557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b28bef-da56-4a29-83f5-86655e85d703 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:35.681106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b28bef-da56-4a29-83f5-86655e85d703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:35.684263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b28bef-da56-4a29-83f5-86655e85d703 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:35.720806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 167/339] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:35.727261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b28bef-da56-4a29-83f5-86655e85d703 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:35.730404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 173/340] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:35.956195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b28bef-da56-4a29-83f5-86655e85d703 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:36.028761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f095ddc-69b1-4c3d-8103-f48df0194c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:36.029807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f095ddc-69b1-4c3d-8103-f48df0194c6b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:36.030294 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f095ddc-69b1-4c3d-8103-f48df0194c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:36.030790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f095ddc-69b1-4c3d-8103-f48df0194c6b None admin] PATH_INFO: `/v3/users/15e1e3c235c44c3793aa95459dca8085` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:36.036248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f095ddc-69b1-4c3d-8103-f48df0194c6b None admin] RBAC: Authorizing `identity:get_user(user_id=15e1e3c235c44c3793aa95459dca8085)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:36.039043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f095ddc-69b1-4c3d-8103-f48df0194c6b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:36.042676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 168/341] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:57:35 2022] GET /identity/v3/users/15e1e3c235c44c3793aa95459dca8085 => generated 293 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:36.050319 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d685583-95f7-452b-b307-7a6ff4e1920a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:36.163856 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f095ddc-69b1-4c3d-8103-f48df0194c6b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:36.230154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:36.240594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d685583-95f7-452b-b307-7a6ff4e1920a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:36.273084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:36.299279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131753d3-31ce-4dd6-8eb3-8406ce8ec942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:36.299901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131753d3-31ce-4dd6-8eb3-8406ce8ec942 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:36.300183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131753d3-31ce-4dd6-8eb3-8406ce8ec942 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:36.300521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131753d3-31ce-4dd6-8eb3-8406ce8ec942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:36.301276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131753d3-31ce-4dd6-8eb3-8406ce8ec942 None admin] RBAC: Adding query filter params (role.id=57523b6804424d1782f8e7df8974669f, user.id=15e1e3c235c44c3793aa95459dca8085, scope.system=all) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:36.301587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131753d3-31ce-4dd6-8eb3-8406ce8ec942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:36.303133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131753d3-31ce-4dd6-8eb3-8406ce8ec942 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:36.328715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 174/342] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Sep 1 11:57:36 2022] GET /identity/v3/role_assignments?user.id=15e1e3c235c44c3793aa95459dca8085&scope.system=all&role.id=57523b6804424d1782f8e7df8974669f => generated 510 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:36.453026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f095ddc-69b1-4c3d-8103-f48df0194c6b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:36.534053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbbf96-439d-4844-af60-d62fb78cde08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:36.535078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbbf96-439d-4844-af60-d62fb78cde08 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:36.535566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbbf96-439d-4844-af60-d62fb78cde08 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:36.536044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbbf96-439d-4844-af60-d62fb78cde08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:36.565802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbbf96-439d-4844-af60-d62fb78cde08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3dbbbf96-439d-4844-af60-d62fb78cde08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:36.578887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:36.579828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:36.580662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 169/343] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:36.587748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131753d3-31ce-4dd6-8eb3-8406ce8ec942 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:36.764993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e351eaa-329d-4706-8561-0afed1ea853a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:36.765371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e351eaa-329d-4706-8561-0afed1ea853a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:36.765580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e351eaa-329d-4706-8561-0afed1ea853a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:36.767089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 170/344] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:36.773054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc130-bc07-4ab4-8d23-35170cca3afd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:36.773413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc130-bc07-4ab4-8d23-35170cca3afd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:36.773596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cc130-bc07-4ab4-8d23-35170cca3afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:36.789491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131753d3-31ce-4dd6-8eb3-8406ce8ec942 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:36.813431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9d2cc130-bc07-4ab4-8d23-35170cca3afd None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:36.814619 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d2cc130-bc07-4ab4-8d23-35170cca3afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:36.845196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d66d05-349b-4047-82e3-14cd818c1738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:36.845837 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d66d05-349b-4047-82e3-14cd818c1738 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:36.846112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d66d05-349b-4047-82e3-14cd818c1738 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:36.846382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d66d05-349b-4047-82e3-14cd818c1738 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:36.847067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d66d05-349b-4047-82e3-14cd818c1738 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:36.847370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d66d05-349b-4047-82e3-14cd818c1738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:36.848799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d66d05-349b-4047-82e3-14cd818c1738 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:36.859109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 175/345] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:36.864988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d66d05-349b-4047-82e3-14cd818c1738 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:36.904757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:36.925875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 171/346] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 11:57:37.003501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d66d05-349b-4047-82e3-14cd818c1738 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:37.060423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d94ce-c406-4e21-8670-12c783004d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:37.060959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d94ce-c406-4e21-8670-12c783004d68 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:37.061232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d94ce-c406-4e21-8670-12c783004d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:37.061519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d94ce-c406-4e21-8670-12c783004d68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:37.156025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d94ce-c406-4e21-8670-12c783004d68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:37.161605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d94ce-c406-4e21-8670-12c783004d68 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:37.196845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:37.308570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 176/347] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 11:57:37.314930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cc130-bc07-4ab4-8d23-35170cca3afd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:37.357010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:37.393615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d94ce-c406-4e21-8670-12c783004d68 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:37.457728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cc130-bc07-4ab4-8d23-35170cca3afd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:37.511025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b0513-7da8-493b-992d-88fade865f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:37.511687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b0513-7da8-493b-992d-88fade865f93 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:37.511955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b0513-7da8-493b-992d-88fade865f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:37.512254 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b0513-7da8-493b-992d-88fade865f93 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:37.520703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b0513-7da8-493b-992d-88fade865f93 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:37.520703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b0513-7da8-493b-992d-88fade865f93 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:37.520703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 172/348] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:37 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:37.528811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b0513-7da8-493b-992d-88fade865f93 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:37.654696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:37.664134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d94ce-c406-4e21-8670-12c783004d68 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:37.670858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b0513-7da8-493b-992d-88fade865f93 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:37.703689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:37.728238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddddbe-fcb6-4bb4-9baa-3115a992314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:37.728238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddddbe-fcb6-4bb4-9baa-3115a992314f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:37.728238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddddbe-fcb6-4bb4-9baa-3115a992314f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:37.728238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddddbe-fcb6-4bb4-9baa-3115a992314f None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:37.733681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9447f35-5119-40f2-8c83-993847eec13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:37.734760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9447f35-5119-40f2-8c83-993847eec13d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:37.735212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9447f35-5119-40f2-8c83-993847eec13d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:37.735638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9447f35-5119-40f2-8c83-993847eec13d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:37.738230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddddbe-fcb6-4bb4-9baa-3115a992314f None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:37.739892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddddbe-fcb6-4bb4-9baa-3115a992314f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:37.741721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 173/349] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:37 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:37.748203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddddbe-fcb6-4bb4-9baa-3115a992314f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:37.755504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9447f35-5119-40f2-8c83-993847eec13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f9447f35-5119-40f2-8c83-993847eec13d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:37.761824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:37.762985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:37.763965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:37.770813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 177/350] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:37.779340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9447f35-5119-40f2-8c83-993847eec13d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:37.905600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddddbe-fcb6-4bb4-9baa-3115a992314f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:37.949196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c983fd-84dd-4d6c-aac8-f6fe30031d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:37.950051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c983fd-84dd-4d6c-aac8-f6fe30031d81 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:37.950345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c983fd-84dd-4d6c-aac8-f6fe30031d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:37.950631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c983fd-84dd-4d6c-aac8-f6fe30031d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:37.951418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c983fd-84dd-4d6c-aac8-f6fe30031d81 None admin] RBAC: Adding query filter params (group.id=45e72bceb70649bdbe1df00a1eb5fd00, role.id=4a2e97979a4c4cd796f797f81fff095a, scope.project.id=960889d116ab4cb4893fa64b6b0869bb) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:37.951740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c983fd-84dd-4d6c-aac8-f6fe30031d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:37.953470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c983fd-84dd-4d6c-aac8-f6fe30031d81 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:37.964866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 174/351] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 1 11:57:37 2022] GET /identity/v3/role_assignments?group.id=45e72bceb70649bdbe1df00a1eb5fd00&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:37.972794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9447f35-5119-40f2-8c83-993847eec13d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:38.021860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858afa5-aec2-4b9e-ba5b-f0f6c855ff67 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:38.022248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858afa5-aec2-4b9e-ba5b-f0f6c855ff67 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:38.022641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858afa5-aec2-4b9e-ba5b-f0f6c855ff67 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:38.023115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21612dc-f4c2-43ab-a973-fa97bc082524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:38.023760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21612dc-f4c2-43ab-a973-fa97bc082524 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:38.024037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21612dc-f4c2-43ab-a973-fa97bc082524 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:38.024338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21612dc-f4c2-43ab-a973-fa97bc082524 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:38.024437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 175/352] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:38.025120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21612dc-f4c2-43ab-a973-fa97bc082524 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:38.025456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21612dc-f4c2-43ab-a973-fa97bc082524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:38.027570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21612dc-f4c2-43ab-a973-fa97bc082524 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:38.031746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9001a-3043-4f1a-b521-a689a93778c3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:38.032069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9001a-3043-4f1a-b521-a689a93778c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:38.032339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9001a-3043-4f1a-b521-a689a93778c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:38.040497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 178/353] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:38.046737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21612dc-f4c2-43ab-a973-fa97bc082524 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:38.064054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d6c9001a-3043-4f1a-b521-a689a93778c3 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:38.065605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d6c9001a-3043-4f1a-b521-a689a93778c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:38.100641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:38.121161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:38.234898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 176/354] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:38.249704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21612dc-f4c2-43ab-a973-fa97bc082524 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:38.330185 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200a2fd-4942-4082-8646-597707e27305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:38.330831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200a2fd-4942-4082-8646-597707e27305 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:38.331119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200a2fd-4942-4082-8646-597707e27305 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:38.331375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200a2fd-4942-4082-8646-597707e27305 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:38.425506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200a2fd-4942-4082-8646-597707e27305 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:38.427009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200a2fd-4942-4082-8646-597707e27305 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:38.474576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:38.553269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 179/355] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:38.559287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9001a-3043-4f1a-b521-a689a93778c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:38.611807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc7d13-51f2-4fce-ac11-17dc4db15f87 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:38.612500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc7d13-51f2-4fce-ac11-17dc4db15f87 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:38.612982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc7d13-51f2-4fce-ac11-17dc4db15f87 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:38.614617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 180/356] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:38.625856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19533ddc-c083-4f43-8799-3b48a652d397 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:38.626475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19533ddc-c083-4f43-8799-3b48a652d397 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:38.626974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19533ddc-c083-4f43-8799-3b48a652d397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:38.671328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-19533ddc-c083-4f43-8799-3b48a652d397 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:38.673061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-19533ddc-c083-4f43-8799-3b48a652d397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:38.708936 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9001a-3043-4f1a-b521-a689a93778c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:38.751586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d954d-e348-4e81-9708-f13c123a7433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:38.752275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d954d-e348-4e81-9708-f13c123a7433 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:38.752562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d954d-e348-4e81-9708-f13c123a7433 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:38.752837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d954d-e348-4e81-9708-f13c123a7433 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:38.754507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d954d-e348-4e81-9708-f13c123a7433 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:38.755973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d954d-e348-4e81-9708-f13c123a7433 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:38.758129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 177/357] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:38 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:38.764153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d954d-e348-4e81-9708-f13c123a7433 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:38.797817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:38.807957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 181/358] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:38.820276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19533ddc-c083-4f43-8799-3b48a652d397 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:38.916906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:38.958490 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d954d-e348-4e81-9708-f13c123a7433 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:38.993152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19533ddc-c083-4f43-8799-3b48a652d397 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:38.998965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069ed6-71f7-4556-bd71-68428dfa8313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:38.999696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069ed6-71f7-4556-bd71-68428dfa8313 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:38.999979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069ed6-71f7-4556-bd71-68428dfa8313 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:39.000282 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069ed6-71f7-4556-bd71-68428dfa8313 None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:39.001497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37069ed6-71f7-4556-bd71-68428dfa8313 None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:39.002962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37069ed6-71f7-4556-bd71-68428dfa8313 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:39.004963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 178/359] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:38 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:39.007121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaac7f-f0c6-4682-b0dd-46bd008dff90 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:39.007604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaac7f-f0c6-4682-b0dd-46bd008dff90 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:39.008105 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaac7f-f0c6-4682-b0dd-46bd008dff90 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:39.011605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 179/360] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:39.012988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaac7f-f0c6-4682-b0dd-46bd008dff90 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:39.079782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc5e05-0d8e-4cbc-9943-bb5e9d759d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:39.080767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc5e05-0d8e-4cbc-9943-bb5e9d759d4c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:39.081197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc5e05-0d8e-4cbc-9943-bb5e9d759d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:39.081618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc5e05-0d8e-4cbc-9943-bb5e9d759d4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:39.116723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc5e05-0d8e-4cbc-9943-bb5e9d759d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-4adc5e05-0d8e-4cbc-9943-bb5e9d759d4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:39.129804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:39.130762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:39.131543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:39.132128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 182/361] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:57:39.134143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3114c94-06df-49f5-b140-f97df9221189 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:39.134640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3114c94-06df-49f5-b140-f97df9221189 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:39.135726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3114c94-06df-49f5-b140-f97df9221189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:39.172627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a3114c94-06df-49f5-b140-f97df9221189 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:39.174471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a3114c94-06df-49f5-b140-f97df9221189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:39.204625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:39.238400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaac7f-f0c6-4682-b0dd-46bd008dff90 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:39.288776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 183/362] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:39.290828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3114c94-06df-49f5-b140-f97df9221189 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:39.295668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35c1b-b038-4ddc-9b6a-f248ccf32f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:39.296343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35c1b-b038-4ddc-9b6a-f248ccf32f91 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:39.296624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35c1b-b038-4ddc-9b6a-f248ccf32f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:39.296891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35c1b-b038-4ddc-9b6a-f248ccf32f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:39.297640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35c1b-b038-4ddc-9b6a-f248ccf32f91 None admin] RBAC: Adding query filter params (group.id=45e72bceb70649bdbe1df00a1eb5fd00, role.id=c76ef09e05ab4b329ff0580b80c56f59, scope.project.id=960889d116ab4cb4893fa64b6b0869bb) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:39.297951 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35c1b-b038-4ddc-9b6a-f248ccf32f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:39.299698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35c1b-b038-4ddc-9b6a-f248ccf32f91 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:39.307122 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 180/363] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 1 11:57:39 2022] GET /identity/v3/role_assignments?group.id=45e72bceb70649bdbe1df00a1eb5fd00&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=c76ef09e05ab4b329ff0580b80c56f59 => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:39.316658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35c1b-b038-4ddc-9b6a-f248ccf32f91 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:39.483926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:39.518116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35c1b-b038-4ddc-9b6a-f248ccf32f91 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:39.565452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2dc64-d1aa-474f-ae42-229caacf39f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:39.566417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3114c94-06df-49f5-b140-f97df9221189 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:39.566591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2dc64-d1aa-474f-ae42-229caacf39f5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:39.566591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2dc64-d1aa-474f-ae42-229caacf39f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:39.566823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2dc64-d1aa-474f-ae42-229caacf39f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:39.580051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2dc64-d1aa-474f-ae42-229caacf39f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d3c2dc64-d1aa-474f-ae42-229caacf39f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:39.586713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:39.589219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:39.592312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 181/364] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:39.602574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2dc64-d1aa-474f-ae42-229caacf39f5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:39.613425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750ac9e-8d6e-4110-a4c1-9b64beceed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:39.614067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750ac9e-8d6e-4110-a4c1-9b64beceed58 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:39.614350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750ac9e-8d6e-4110-a4c1-9b64beceed58 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:39.614625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750ac9e-8d6e-4110-a4c1-9b64beceed58 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:39.615324 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750ac9e-8d6e-4110-a4c1-9b64beceed58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:39.615631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750ac9e-8d6e-4110-a4c1-9b64beceed58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:39.616973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:39.619776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750ac9e-8d6e-4110-a4c1-9b64beceed58 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:39.631904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 184/365] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:39.640760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750ac9e-8d6e-4110-a4c1-9b64beceed58 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:39.783359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750ac9e-8d6e-4110-a4c1-9b64beceed58 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:39.810286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:39.827884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44f366-2b5c-497b-99b7-ce3d7c653907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:39.828577 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44f366-2b5c-497b-99b7-ce3d7c653907 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:39.828861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44f366-2b5c-497b-99b7-ce3d7c653907 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:39.829141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44f366-2b5c-497b-99b7-ce3d7c653907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:39.895417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2dc64-d1aa-474f-ae42-229caacf39f5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:39.915316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44f366-2b5c-497b-99b7-ce3d7c653907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:39.917075 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44f366-2b5c-497b-99b7-ce3d7c653907 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:39.976452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad38edf-d829-4a6a-82d1-4fcdd4c2149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:39.977927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38edf-d829-4a6a-82d1-4fcdd4c2149a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:39.978769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38edf-d829-4a6a-82d1-4fcdd4c2149a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:39.979629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38edf-d829-4a6a-82d1-4fcdd4c2149a None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:39.981971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad38edf-d829-4a6a-82d1-4fcdd4c2149a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:39.982950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad38edf-d829-4a6a-82d1-4fcdd4c2149a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:39.986283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad38edf-d829-4a6a-82d1-4fcdd4c2149a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:40.005422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 182/366] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:40.007526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad38edf-d829-4a6a-82d1-4fcdd4c2149a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:40.035087 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 185/367] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:40.035887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44f366-2b5c-497b-99b7-ce3d7c653907 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:40.065971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:40.184105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44f366-2b5c-497b-99b7-ce3d7c653907 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:40.199927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:40.237549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad38edf-d829-4a6a-82d1-4fcdd4c2149a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:40.258033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b19b6-37b5-4262-86c8-043a30412903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:40.259809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b19b6-37b5-4262-86c8-043a30412903 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:40.260673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b19b6-37b5-4262-86c8-043a30412903 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:40.261503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b19b6-37b5-4262-86c8-043a30412903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:40.279639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305cd4-6d47-49f9-8db8-6a926d1394f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:40.280442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305cd4-6d47-49f9-8db8-6a926d1394f5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:40.280924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305cd4-6d47-49f9-8db8-6a926d1394f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:40.281347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305cd4-6d47-49f9-8db8-6a926d1394f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:40.294403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c305cd4-6d47-49f9-8db8-6a926d1394f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9c305cd4-6d47-49f9-8db8-6a926d1394f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:40.301224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:40.302209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:40.303033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:40.305123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 183/368] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:40.306229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305cd4-6d47-49f9-8db8-6a926d1394f5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:40.417460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b19b6-37b5-4262-86c8-043a30412903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:40.420765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b19b6-37b5-4262-86c8-043a30412903 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:40.426240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305cd4-6d47-49f9-8db8-6a926d1394f5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:40.472786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:40.483320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:40.495123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84bd52-93d0-48e0-80d9-207e9197a4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:40.496276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84bd52-93d0-48e0-80d9-207e9197a4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:40.497007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84bd52-93d0-48e0-80d9-207e9197a4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:40.498788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84bd52-93d0-48e0-80d9-207e9197a4c5 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:40.501024 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84bd52-93d0-48e0-80d9-207e9197a4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:40.503793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84bd52-93d0-48e0-80d9-207e9197a4c5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:40.508718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 184/369] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:40 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:40.511711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84bd52-93d0-48e0-80d9-207e9197a4c5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:40.656084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 186/370] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:40.659098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b19b6-37b5-4262-86c8-043a30412903 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:40.704158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84bd52-93d0-48e0-80d9-207e9197a4c5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:40.765241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745b5b6-ec4f-4301-9f64-e18475bfab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:40.766707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745b5b6-ec4f-4301-9f64-e18475bfab2c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:40.767171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745b5b6-ec4f-4301-9f64-e18475bfab2c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:40.767680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745b5b6-ec4f-4301-9f64-e18475bfab2c None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:40.768625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745b5b6-ec4f-4301-9f64-e18475bfab2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:40.769128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745b5b6-ec4f-4301-9f64-e18475bfab2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:40.771362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745b5b6-ec4f-4301-9f64-e18475bfab2c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:40.783706 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 185/371] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:40.784881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745b5b6-ec4f-4301-9f64-e18475bfab2c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:40.930344 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b19b6-37b5-4262-86c8-043a30412903 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:40.931013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:40.980647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:41.009416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8232e2-338e-46e7-b691-91a704fe595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:41.010994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8232e2-338e-46e7-b691-91a704fe595e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:41.011498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8232e2-338e-46e7-b691-91a704fe595e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:41.012854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8232e2-338e-46e7-b691-91a704fe595e None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:41.015233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8232e2-338e-46e7-b691-91a704fe595e None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:41.018997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8232e2-338e-46e7-b691-91a704fe595e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:41.023342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 187/372] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:40 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:41.024921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8232e2-338e-46e7-b691-91a704fe595e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:41.039776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745b5b6-ec4f-4301-9f64-e18475bfab2c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:41.115370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828d003-78ca-47d9-a847-7b5731e62575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:41.116023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828d003-78ca-47d9-a847-7b5731e62575 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:41.116349 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828d003-78ca-47d9-a847-7b5731e62575 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:41.116628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828d003-78ca-47d9-a847-7b5731e62575 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:41.117834 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828d003-78ca-47d9-a847-7b5731e62575 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:41.119861 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828d003-78ca-47d9-a847-7b5731e62575 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:41.122489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 186/373] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:40 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:41.123144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828d003-78ca-47d9-a847-7b5731e62575 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:41.259340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8232e2-338e-46e7-b691-91a704fe595e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:41.290263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828d003-78ca-47d9-a847-7b5731e62575 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:41.331795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:41.333891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6dcd7-abaf-408a-aa09-3067be026c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:41.335357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6dcd7-abaf-408a-aa09-3067be026c9a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:41.336164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6dcd7-abaf-408a-aa09-3067be026c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:41.337154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6dcd7-abaf-408a-aa09-3067be026c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:41.340889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779878d-923d-41a0-aa5d-1546c66dd622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:41.345707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779878d-923d-41a0-aa5d-1546c66dd622 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:41.345707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779878d-923d-41a0-aa5d-1546c66dd622 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:41.345707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779878d-923d-41a0-aa5d-1546c66dd622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:41.345707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779878d-923d-41a0-aa5d-1546c66dd622 None admin] RBAC: Adding query filter params (group.id=45e72bceb70649bdbe1df00a1eb5fd00, role.id=4a2e97979a4c4cd796f797f81fff095a, scope.project.id=4c832ded083c47aab25b1b28396beea6) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:41.345707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779878d-923d-41a0-aa5d-1546c66dd622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:41.345707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779878d-923d-41a0-aa5d-1546c66dd622 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:41.354190 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 187/374] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 1 11:57:41 2022] GET /identity/v3/role_assignments?group.id=45e72bceb70649bdbe1df00a1eb5fd00&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:41.354421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57a6ac-da55-4aae-9de1-9895fbeb6396 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:41.354760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57a6ac-da55-4aae-9de1-9895fbeb6396 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:41.355008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57a6ac-da55-4aae-9de1-9895fbeb6396 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:41.356908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 188/375] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:41.357915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57a6ac-da55-4aae-9de1-9895fbeb6396 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:41.472443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:41.494473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6dcd7-abaf-408a-aa09-3067be026c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:41.498370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6dcd7-abaf-408a-aa09-3067be026c9a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:41.519160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57a6ac-da55-4aae-9de1-9895fbeb6396 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:41.567473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dc1e4-cdeb-4896-9086-8215e20ab7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:41.567933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dc1e4-cdeb-4896-9086-8215e20ab7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:41.568203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dc1e4-cdeb-4896-9086-8215e20ab7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:41.568596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dc1e4-cdeb-4896-9086-8215e20ab7a7 None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:41.569849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dc1e4-cdeb-4896-9086-8215e20ab7a7 None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:41.571406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dc1e4-cdeb-4896-9086-8215e20ab7a7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:41.575934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 189/376] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:41 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:41.577500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad4ba8-494b-4e58-9634-3d8cfef45bd3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:41.577798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad4ba8-494b-4e58-9634-3d8cfef45bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:41.578067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad4ba8-494b-4e58-9634-3d8cfef45bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:41.598509 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-14ad4ba8-494b-4e58-9634-3d8cfef45bd3 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:41.599742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-14ad4ba8-494b-4e58-9634-3d8cfef45bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:41.675402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:41.690676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 190/377] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:41.691548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad4ba8-494b-4e58-9634-3d8cfef45bd3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:41.723027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 188/378] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:41.730997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6dcd7-abaf-408a-aa09-3067be026c9a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:41.950794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:41.980151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6dcd7-abaf-408a-aa09-3067be026c9a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:41.982502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad4ba8-494b-4e58-9634-3d8cfef45bd3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:42.059761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cba6a8-13a9-46fc-aa1d-0c1b58ddf675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:42.060787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba6a8-13a9-46fc-aa1d-0c1b58ddf675 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:42.061275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba6a8-13a9-46fc-aa1d-0c1b58ddf675 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:42.061777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba6a8-13a9-46fc-aa1d-0c1b58ddf675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:42.062364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aa7aa-d198-4426-adee-da953b8339e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:42.062987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cba6a8-13a9-46fc-aa1d-0c1b58ddf675 None admin] RBAC: Adding query filter params (group.id=45e72bceb70649bdbe1df00a1eb5fd00, role.id=c76ef09e05ab4b329ff0580b80c56f59, scope.project.id=4c832ded083c47aab25b1b28396beea6) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:42.063478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aa7aa-d198-4426-adee-da953b8339e0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:42.063716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cba6a8-13a9-46fc-aa1d-0c1b58ddf675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:42.063981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aa7aa-d198-4426-adee-da953b8339e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:42.064524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aa7aa-d198-4426-adee-da953b8339e0 None admin] PATH_INFO: `/v3/projects/8fa27a3f862749599654d7d59ff48c18` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:42.072717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cba6a8-13a9-46fc-aa1d-0c1b58ddf675 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:42.072911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237aa7aa-d198-4426-adee-da953b8339e0 None admin] RBAC: Authorizing `identity:get_project(project_id=8fa27a3f862749599654d7d59ff48c18)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:42.072911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237aa7aa-d198-4426-adee-da953b8339e0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:42.073637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 189/379] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:41 2022] GET /identity/v3/projects/8fa27a3f862749599654d7d59ff48c18 => generated 344 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:42.080028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875fef0-0f30-458b-9a0e-d4e950f46ab4 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:42.080028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875fef0-0f30-458b-9a0e-d4e950f46ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:42.080028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875fef0-0f30-458b-9a0e-d4e950f46ab4 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:42.080503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 190/380] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:42.081865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875fef0-0f30-458b-9a0e-d4e950f46ab4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:42.086005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 191/381] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 1 11:57:41 2022] GET /identity/v3/role_assignments?group.id=45e72bceb70649bdbe1df00a1eb5fd00&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=c76ef09e05ab4b329ff0580b80c56f59 => generated 260 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:42.105687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61696065-4322-44e9-91ba-0967ab9e15fb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:42.106325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61696065-4322-44e9-91ba-0967ab9e15fb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:42.106830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61696065-4322-44e9-91ba-0967ab9e15fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:42.131966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-61696065-4322-44e9-91ba-0967ab9e15fb None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:42.133254 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-61696065-4322-44e9-91ba-0967ab9e15fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:42.203047 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:42.225387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 192/382] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:42.226481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61696065-4322-44e9-91ba-0967ab9e15fb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:42.356928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875fef0-0f30-458b-9a0e-d4e950f46ab4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:42.422261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61696065-4322-44e9-91ba-0967ab9e15fb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:42.440587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1095-b3fd-4d58-afa1-027f6ca27468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:42.441244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1095-b3fd-4d58-afa1-027f6ca27468 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:42.441523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1095-b3fd-4d58-afa1-027f6ca27468 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:42.441802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1095-b3fd-4d58-afa1-027f6ca27468 None admin] PATH_INFO: `/v3/groups/edb5d94df41b48f8aa8bb4b3536deb68` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:42.456888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d1095-b3fd-4d58-afa1-027f6ca27468 None admin] RBAC: Authorizing `identity:get_group(group_id=edb5d94df41b48f8aa8bb4b3536deb68)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:42.458342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d1095-b3fd-4d58-afa1-027f6ca27468 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:42.460114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 191/383] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:42 2022] GET /identity/v3/groups/edb5d94df41b48f8aa8bb4b3536deb68 => generated 229 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:42.466542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1095-b3fd-4d58-afa1-027f6ca27468 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:42.504172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36febaae-cb5c-4965-ab31-cb908247295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:42.504875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36febaae-cb5c-4965-ab31-cb908247295e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:42.505158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36febaae-cb5c-4965-ab31-cb908247295e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:42.505487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36febaae-cb5c-4965-ab31-cb908247295e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:42.514724 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:42.530372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36febaae-cb5c-4965-ab31-cb908247295e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-36febaae-cb5c-4965-ab31-cb908247295e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:42.535476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:42.536608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:42.537589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:42.543589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 193/384] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:42.550109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36febaae-cb5c-4965-ab31-cb908247295e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:42.657300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1095-b3fd-4d58-afa1-027f6ca27468 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:42.713955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:42.781252 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3592800-09bf-4b29-bfb3-e13df9fdde9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:42.782300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3592800-09bf-4b29-bfb3-e13df9fdde9b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:42.782794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3592800-09bf-4b29-bfb3-e13df9fdde9b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:42.783283 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3592800-09bf-4b29-bfb3-e13df9fdde9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:42.789414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3592800-09bf-4b29-bfb3-e13df9fdde9b None admin] RBAC: Adding query filter params (group.id=edb5d94df41b48f8aa8bb4b3536deb68, role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=8fa27a3f862749599654d7d59ff48c18) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:42.790086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3592800-09bf-4b29-bfb3-e13df9fdde9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:42.793038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3592800-09bf-4b29-bfb3-e13df9fdde9b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:42.813047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 192/385] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 1 11:57:42 2022] GET /identity/v3/role_assignments?group.id=edb5d94df41b48f8aa8bb4b3536deb68&scope.project.id=8fa27a3f862749599654d7d59ff48c18&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 260 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:42.814644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3592800-09bf-4b29-bfb3-e13df9fdde9b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:42.846067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36febaae-cb5c-4965-ab31-cb908247295e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:42.897587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f018dd8-2f83-4b18-b885-c339a513fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:42.898634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f018dd8-2f83-4b18-b885-c339a513fd4d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:42.899396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f018dd8-2f83-4b18-b885-c339a513fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:42.899923 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f018dd8-2f83-4b18-b885-c339a513fd4d None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:42.901407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f018dd8-2f83-4b18-b885-c339a513fd4d None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:42.903506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f018dd8-2f83-4b18-b885-c339a513fd4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:42.906260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f018dd8-2f83-4b18-b885-c339a513fd4d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:42.926967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 194/386] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:42.934107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f018dd8-2f83-4b18-b885-c339a513fd4d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:43.015774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:43.070887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3592800-09bf-4b29-bfb3-e13df9fdde9b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:43.181773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f528f47-3175-458a-9975-6beeb9fbe33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:43.182868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528f47-3175-458a-9975-6beeb9fbe33b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:43.183611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528f47-3175-458a-9975-6beeb9fbe33b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:43.184114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528f47-3175-458a-9975-6beeb9fbe33b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:43.208653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f018dd8-2f83-4b18-b885-c339a513fd4d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:43.221122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f528f47-3175-458a-9975-6beeb9fbe33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-4f528f47-3175-458a-9975-6beeb9fbe33b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:43.239652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:43.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:43.241529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:43.242112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 193/387] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:43.250843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f528f47-3175-458a-9975-6beeb9fbe33b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:43.252629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:43.304628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59937efc-b324-41d8-b7f5-e853aed606be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:43.305913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59937efc-b324-41d8-b7f5-e853aed606be None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:43.307134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59937efc-b324-41d8-b7f5-e853aed606be None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:43.307628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59937efc-b324-41d8-b7f5-e853aed606be None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:43.312241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59937efc-b324-41d8-b7f5-e853aed606be None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:43.312901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59937efc-b324-41d8-b7f5-e853aed606be None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:43.318739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 195/388] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:42 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:43.331329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59937efc-b324-41d8-b7f5-e853aed606be None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:43.463388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f528f47-3175-458a-9975-6beeb9fbe33b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:43.532353 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59937efc-b324-41d8-b7f5-e853aed606be None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:43.536767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7d161-c529-4e49-99de-c86bc84b3759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:43.537721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7d161-c529-4e49-99de-c86bc84b3759 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:43.538205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7d161-c529-4e49-99de-c86bc84b3759 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:43.538723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7d161-c529-4e49-99de-c86bc84b3759 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:43.539632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7d161-c529-4e49-99de-c86bc84b3759 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:43.540669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7d161-c529-4e49-99de-c86bc84b3759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:43.542800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7d161-c529-4e49-99de-c86bc84b3759 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:43.564944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 194/389] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:43.571535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7d161-c529-4e49-99de-c86bc84b3759 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:43.589112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:43.621631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152eef9-bc47-4c0d-b2fc-b3f4774fbd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:43.622659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152eef9-bc47-4c0d-b2fc-b3f4774fbd2e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:43.623214 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152eef9-bc47-4c0d-b2fc-b3f4774fbd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:43.623812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152eef9-bc47-4c0d-b2fc-b3f4774fbd2e None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:43.626175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152eef9-bc47-4c0d-b2fc-b3f4774fbd2e None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:43.628014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152eef9-bc47-4c0d-b2fc-b3f4774fbd2e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:43.638547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 196/390] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:43 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:43.648795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152eef9-bc47-4c0d-b2fc-b3f4774fbd2e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:43.747475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:43.800599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7d161-c529-4e49-99de-c86bc84b3759 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:43.868715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152eef9-bc47-4c0d-b2fc-b3f4774fbd2e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:43.871348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1993f8e-e4cd-4e21-b2d4-982548a71aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:43.872008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1993f8e-e4cd-4e21-b2d4-982548a71aee None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:43.872324 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1993f8e-e4cd-4e21-b2d4-982548a71aee None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:43.872604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1993f8e-e4cd-4e21-b2d4-982548a71aee None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:43.873822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1993f8e-e4cd-4e21-b2d4-982548a71aee None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:43.875283 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1993f8e-e4cd-4e21-b2d4-982548a71aee None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:43.878467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 195/391] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:43 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:43.888143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1993f8e-e4cd-4e21-b2d4-982548a71aee None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:43.920594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58361e36-52b8-42dd-8c9f-02aa2256e02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:43.921285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58361e36-52b8-42dd-8c9f-02aa2256e02b None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:43.921564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58361e36-52b8-42dd-8c9f-02aa2256e02b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:43.921841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58361e36-52b8-42dd-8c9f-02aa2256e02b None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb/groups/45e72bceb70649bdbe1df00a1eb5fd00/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:43.925425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58361e36-52b8-42dd-8c9f-02aa2256e02b None admin] RBAC: Authorizing `identity:create_grant(project_id=960889d116ab4cb4893fa64b6b0869bb, group_id=45e72bceb70649bdbe1df00a1eb5fd00, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:43.928683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58361e36-52b8-42dd-8c9f-02aa2256e02b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:44.008888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:44.020848 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 197/392] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Sep 1 11:57:43 2022] PUT /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb/groups/45e72bceb70649bdbe1df00a1eb5fd00/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 11:57:44.059646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1993f8e-e4cd-4e21-b2d4-982548a71aee None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:44.114983 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db424b5-25fe-4221-84b8-1c106f602c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:44.115642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db424b5-25fe-4221-84b8-1c106f602c0e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:44.115922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db424b5-25fe-4221-84b8-1c106f602c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:44.116197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db424b5-25fe-4221-84b8-1c106f602c0e None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:44.121299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db424b5-25fe-4221-84b8-1c106f602c0e None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:44.122744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db424b5-25fe-4221-84b8-1c106f602c0e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:44.124959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 196/393] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:43 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:44.134553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58361e36-52b8-42dd-8c9f-02aa2256e02b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:44.338362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58361e36-52b8-42dd-8c9f-02aa2256e02b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:44.341623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:44.383334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a76d1-078b-4b05-a476-f1b50de1919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:44.383921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a76d1-078b-4b05-a476-f1b50de1919d None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:44.384255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a76d1-078b-4b05-a476-f1b50de1919d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:44.384645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a76d1-078b-4b05-a476-f1b50de1919d None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb/groups/45e72bceb70649bdbe1df00a1eb5fd00/roles/c76ef09e05ab4b329ff0580b80c56f59` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:44.387153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a76d1-078b-4b05-a476-f1b50de1919d None admin] RBAC: Authorizing `identity:create_grant(project_id=960889d116ab4cb4893fa64b6b0869bb, group_id=45e72bceb70649bdbe1df00a1eb5fd00, role_id=c76ef09e05ab4b329ff0580b80c56f59)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:44.388764 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a76d1-078b-4b05-a476-f1b50de1919d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:44.467390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 198/394] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Sep 1 11:57:44 2022] PUT /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb/groups/45e72bceb70649bdbe1df00a1eb5fd00/roles/c76ef09e05ab4b329ff0580b80c56f59 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 11:57:44.612653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3988650-3ff3-4f7e-9e19-1ecb2ab16911 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:44.613079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3988650-3ff3-4f7e-9e19-1ecb2ab16911 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:44.613339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3988650-3ff3-4f7e-9e19-1ecb2ab16911 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:44.615019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 197/395] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:44.622548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cbdc0-f446-40fc-add4-97e98fa2b633 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:44.623072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cbdc0-f446-40fc-add4-97e98fa2b633 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:44.623307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cbdc0-f446-40fc-add4-97e98fa2b633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:44.651942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-869cbdc0-f446-40fc-add4-97e98fa2b633 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:44.653235 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-869cbdc0-f446-40fc-add4-97e98fa2b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:44.755371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 199/396] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:45.114514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3988650-3ff3-4f7e-9e19-1ecb2ab16911 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:45.324151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3988650-3ff3-4f7e-9e19-1ecb2ab16911 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:45.411726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a896d7a-dd94-4904-9c02-8bf5ae8b3678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:45.413227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a896d7a-dd94-4904-9c02-8bf5ae8b3678 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:45.413897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a896d7a-dd94-4904-9c02-8bf5ae8b3678 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:45.414616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a896d7a-dd94-4904-9c02-8bf5ae8b3678 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:45.441912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a896d7a-dd94-4904-9c02-8bf5ae8b3678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:45.452193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3bfc2-f8bf-4197-b52d-c07f168cf38f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8a896d7a-dd94-4904-9c02-8bf5ae8b3678 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:45.452918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:45.454359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:45.455838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 198/397] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:45.458502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3bfc2-f8bf-4197-b52d-c07f168cf38f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:45.459296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3bfc2-f8bf-4197-b52d-c07f168cf38f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:45.461549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a896d7a-dd94-4904-9c02-8bf5ae8b3678 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:45.465051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:45.470801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 200/398] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:45 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:45.479778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601133-e5cd-4b43-947d-288e64f36763 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:45.480280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601133-e5cd-4b43-947d-288e64f36763 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:45.481026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601133-e5cd-4b43-947d-288e64f36763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:45.532934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f7601133-e5cd-4b43-947d-288e64f36763 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:45.535121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f7601133-e5cd-4b43-947d-288e64f36763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:45.711719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 201/399] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:45.743569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a896d7a-dd94-4904-9c02-8bf5ae8b3678 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:45.806855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139ddf3-149a-40a0-aee4-f49379c3fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:45.807487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ddf3-149a-40a0-aee4-f49379c3fb98 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:45.807771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ddf3-149a-40a0-aee4-f49379c3fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:45.808048 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ddf3-149a-40a0-aee4-f49379c3fb98 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:45.808766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139ddf3-149a-40a0-aee4-f49379c3fb98 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:45.809073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139ddf3-149a-40a0-aee4-f49379c3fb98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:45.810480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139ddf3-149a-40a0-aee4-f49379c3fb98 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:45.828179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 199/400] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:45.834425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601133-e5cd-4b43-947d-288e64f36763 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:45.891571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:46.042912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601133-e5cd-4b43-947d-288e64f36763 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:46.106098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930b903-809a-4066-bdc8-e9f95260acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:46.107161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930b903-809a-4066-bdc8-e9f95260acaf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:46.107651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930b903-809a-4066-bdc8-e9f95260acaf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:46.108135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930b903-809a-4066-bdc8-e9f95260acaf None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:46.110152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930b903-809a-4066-bdc8-e9f95260acaf None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:46.112964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930b903-809a-4066-bdc8-e9f95260acaf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:46.116427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 202/401] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:45 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:46.121912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139ddf3-149a-40a0-aee4-f49379c3fb98 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:46.233235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:46.288539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139ddf3-149a-40a0-aee4-f49379c3fb98 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:46.341699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6d106-4ac5-4512-b8fb-e7a8c86482d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:46.342663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6d106-4ac5-4512-b8fb-e7a8c86482d6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:46.343143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6d106-4ac5-4512-b8fb-e7a8c86482d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:46.343597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6d106-4ac5-4512-b8fb-e7a8c86482d6 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:46.345114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6d106-4ac5-4512-b8fb-e7a8c86482d6 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:46.346809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6d106-4ac5-4512-b8fb-e7a8c86482d6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:46.348826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 200/402] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:46 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:46.356518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930b903-809a-4066-bdc8-e9f95260acaf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:46.370983 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6d106-4ac5-4512-b8fb-e7a8c86482d6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:46.532513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930b903-809a-4066-bdc8-e9f95260acaf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:46.544522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:46.576842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6d106-4ac5-4512-b8fb-e7a8c86482d6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:46.577094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a47b96-50e0-4f77-8281-96112ae70e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:46.578105 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a47b96-50e0-4f77-8281-96112ae70e4f None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:46.578564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a47b96-50e0-4f77-8281-96112ae70e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:46.579022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a47b96-50e0-4f77-8281-96112ae70e4f None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6/groups/45e72bceb70649bdbe1df00a1eb5fd00/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:46.583673 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a47b96-50e0-4f77-8281-96112ae70e4f None admin] RBAC: Authorizing `identity:create_grant(project_id=4c832ded083c47aab25b1b28396beea6, group_id=45e72bceb70649bdbe1df00a1eb5fd00, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:46.586249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a47b96-50e0-4f77-8281-96112ae70e4f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:46.623793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:46.630231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb3ee3-55cf-4f77-8c02-b7bb7f1cd4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:46.631006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb3ee3-55cf-4f77-8c02-b7bb7f1cd4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:46.631401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb3ee3-55cf-4f77-8c02-b7bb7f1cd4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:46.631818 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb3ee3-55cf-4f77-8c02-b7bb7f1cd4d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:46.650734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb3ee3-55cf-4f77-8c02-b7bb7f1cd4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-95bb3ee3-55cf-4f77-8c02-b7bb7f1cd4d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:46.656266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:46.657966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:46.660673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 201/403] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:57:46.663242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1126-e5c5-42d6-9e4b-51870c224eaf None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:46.663242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1126-e5c5-42d6-9e4b-51870c224eaf None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:46.663242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1126-e5c5-42d6-9e4b-51870c224eaf None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:46.667324 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 202/404] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:46.670056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc1126-e5c5-42d6-9e4b-51870c224eaf None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:46.702238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 203/405] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Sep 1 11:57:46 2022] PUT /identity/v3/projects/4c832ded083c47aab25b1b28396beea6/groups/45e72bceb70649bdbe1df00a1eb5fd00/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 11:57:46.713237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8be113-4b66-4724-87ff-ff3b552b16e2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:46.713677 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8be113-4b66-4724-87ff-ff3b552b16e2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:46.714093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8be113-4b66-4724-87ff-ff3b552b16e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:46.768618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-de8be113-4b66-4724-87ff-ff3b552b16e2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:46.776243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de8be113-4b66-4724-87ff-ff3b552b16e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:46.975510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc1126-e5c5-42d6-9e4b-51870c224eaf None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:46.999913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 204/406] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:47.059513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e84ee6-96ed-4523-ab97-6d7e4f2eeb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:47.060524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e84ee6-96ed-4523-ab97-6d7e4f2eeb22 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:47.060978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e84ee6-96ed-4523-ab97-6d7e4f2eeb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:47.061435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e84ee6-96ed-4523-ab97-6d7e4f2eeb22 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:47.062554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e84ee6-96ed-4523-ab97-6d7e4f2eeb22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:47.063103 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e84ee6-96ed-4523-ab97-6d7e4f2eeb22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:47.065931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e84ee6-96ed-4523-ab97-6d7e4f2eeb22 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:47.082997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 203/407] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:47.092378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8be113-4b66-4724-87ff-ff3b552b16e2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:47.267753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:47.314973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8be113-4b66-4724-87ff-ff3b552b16e2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:47.328967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf52d7-3e01-4215-a6f6-f05949b70e15 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:47.329497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf52d7-3e01-4215-a6f6-f05949b70e15 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:47.329933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf52d7-3e01-4215-a6f6-f05949b70e15 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:47.339741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 204/408] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:47.342709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b35cd-320b-4907-8ce7-2c76d83c76aa None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:47.343211 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b35cd-320b-4907-8ce7-2c76d83c76aa None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:47.343669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b35cd-320b-4907-8ce7-2c76d83c76aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:47.388612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f38b35cd-320b-4907-8ce7-2c76d83c76aa None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:47.390299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f38b35cd-320b-4907-8ce7-2c76d83c76aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:47.401841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a7b5b-5cc1-4e1a-9f72-acffa1ddf900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:47.402511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a7b5b-5cc1-4e1a-9f72-acffa1ddf900 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:47.402792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a7b5b-5cc1-4e1a-9f72-acffa1ddf900 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:47.403067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a7b5b-5cc1-4e1a-9f72-acffa1ddf900 None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:47.404468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a7b5b-5cc1-4e1a-9f72-acffa1ddf900 None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:47.405962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a7b5b-5cc1-4e1a-9f72-acffa1ddf900 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:47.407951 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 205/409] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:47 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:47.408651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a7b5b-5cc1-4e1a-9f72-acffa1ddf900 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:47.460946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:47.484019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 205/410] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:47.485334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b35cd-320b-4907-8ce7-2c76d83c76aa None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:47.616417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a7b5b-5cc1-4e1a-9f72-acffa1ddf900 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:47.694779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b35cd-320b-4907-8ce7-2c76d83c76aa None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:47.707443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47895e3e-f12a-4374-8466-0f20f979f891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:47.708596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47895e3e-f12a-4374-8466-0f20f979f891 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:47.709100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47895e3e-f12a-4374-8466-0f20f979f891 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:47.709587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47895e3e-f12a-4374-8466-0f20f979f891 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:47.736640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299202af-2cf2-4246-9c51-ae5a35a7d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:47.737681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299202af-2cf2-4246-9c51-ae5a35a7d367 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:47.738164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299202af-2cf2-4246-9c51-ae5a35a7d367 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:47.738640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299202af-2cf2-4246-9c51-ae5a35a7d367 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:47.740066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299202af-2cf2-4246-9c51-ae5a35a7d367 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:47.741785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299202af-2cf2-4246-9c51-ae5a35a7d367 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:47.744060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 206/411] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:47 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:47.746155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47895e3e-f12a-4374-8466-0f20f979f891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-47895e3e-f12a-4374-8466-0f20f979f891 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:47.756480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:47.757421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:47.758229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:47.758827 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 206/412] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:57:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:47.760605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299202af-2cf2-4246-9c51-ae5a35a7d367 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:47.766753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47895e3e-f12a-4374-8466-0f20f979f891 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:47.800770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:47.932426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:48.004061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47895e3e-f12a-4374-8466-0f20f979f891 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:48.036549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299202af-2cf2-4246-9c51-ae5a35a7d367 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:48.089989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d00bd-e6cb-4019-826c-98300da6c7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:48.091328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d00bd-e6cb-4019-826c-98300da6c7fa None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:48.091958 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d00bd-e6cb-4019-826c-98300da6c7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:48.092604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d00bd-e6cb-4019-826c-98300da6c7fa None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:48.094025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d00bd-e6cb-4019-826c-98300da6c7fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:48.094689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d00bd-e6cb-4019-826c-98300da6c7fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:48.097546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d00bd-e6cb-4019-826c-98300da6c7fa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:48.116931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 207/413] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:48.119620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d00bd-e6cb-4019-826c-98300da6c7fa None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:48.120308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313a87a-d851-40a8-9fd1-b6018a805b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:48.121599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313a87a-d851-40a8-9fd1-b6018a805b66 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:48.122242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313a87a-d851-40a8-9fd1-b6018a805b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:48.122789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313a87a-d851-40a8-9fd1-b6018a805b66 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6/groups/45e72bceb70649bdbe1df00a1eb5fd00/roles/c76ef09e05ab4b329ff0580b80c56f59` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:48.129265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313a87a-d851-40a8-9fd1-b6018a805b66 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c832ded083c47aab25b1b28396beea6, group_id=45e72bceb70649bdbe1df00a1eb5fd00, role_id=c76ef09e05ab4b329ff0580b80c56f59)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:48.132380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313a87a-d851-40a8-9fd1-b6018a805b66 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:48.223594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 207/414] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Sep 1 11:57:47 2022] PUT /identity/v3/projects/4c832ded083c47aab25b1b28396beea6/groups/45e72bceb70649bdbe1df00a1eb5fd00/roles/c76ef09e05ab4b329ff0580b80c56f59 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:57:48.224776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313a87a-d851-40a8-9fd1-b6018a805b66 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:48.300970 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:48.356597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d00bd-e6cb-4019-826c-98300da6c7fa None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:48.393406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313a87a-d851-40a8-9fd1-b6018a805b66 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:48.407974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8224bab-43ff-4ceb-9542-774c736e0c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:48.408653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224bab-43ff-4ceb-9542-774c736e0c18 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:48.408932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224bab-43ff-4ceb-9542-774c736e0c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:48.409208 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224bab-43ff-4ceb-9542-774c736e0c18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:48.411569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:48.422100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8224bab-43ff-4ceb-9542-774c736e0c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c8224bab-43ff-4ceb-9542-774c736e0c18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:48.428146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:48.429585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 208/415] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:48.430805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f59bc-e718-4264-b18c-393d507e52f9 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:48.431756 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f59bc-e718-4264-b18c-393d507e52f9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:48.431756 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f59bc-e718-4264-b18c-393d507e52f9 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:48.432927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 209/416] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:48.444914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1f56a-ed22-400e-8de8-5d648c03736d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:48.445256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1f56a-ed22-400e-8de8-5d648c03736d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:48.445483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1f56a-ed22-400e-8de8-5d648c03736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:48.461290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4fd8-ca4c-4af5-bc99-f57814e2adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:48.462322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4fd8-ca4c-4af5-bc99-f57814e2adfb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:48.463261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4fd8-ca4c-4af5-bc99-f57814e2adfb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:48.463749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4fd8-ca4c-4af5-bc99-f57814e2adfb None admin] PATH_INFO: `/v3/groups/edb5d94df41b48f8aa8bb4b3536deb68` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:48.466143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e4fd8-ca4c-4af5-bc99-f57814e2adfb None admin] RBAC: Authorizing `identity:get_group(group_id=edb5d94df41b48f8aa8bb4b3536deb68)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:48.466339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8fd1f56a-ed22-400e-8de8-5d648c03736d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:48.467743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8fd1f56a-ed22-400e-8de8-5d648c03736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:48.468035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e4fd8-ca4c-4af5-bc99-f57814e2adfb None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:48.470440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 208/417] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:48 2022] GET /identity/v3/groups/edb5d94df41b48f8aa8bb4b3536deb68 => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:48.472942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4fd8-ca4c-4af5-bc99-f57814e2adfb None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:48.554997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 210/418] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:48.561812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1f56a-ed22-400e-8de8-5d648c03736d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:48.607120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4fd8-ca4c-4af5-bc99-f57814e2adfb None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:48.648403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd316-27d4-47b2-8758-f568b32b6f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:48.649367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd316-27d4-47b2-8758-f568b32b6f2f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:48.649913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd316-27d4-47b2-8758-f568b32b6f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:48.651389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd316-27d4-47b2-8758-f568b32b6f2f None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:48.652663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dd316-27d4-47b2-8758-f568b32b6f2f None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:48.653192 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dd316-27d4-47b2-8758-f568b32b6f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:48.654790 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dd316-27d4-47b2-8758-f568b32b6f2f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:48.665204 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 209/419] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:48.670978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd316-27d4-47b2-8758-f568b32b6f2f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:48.727988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:48.762294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:48.774278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1f56a-ed22-400e-8de8-5d648c03736d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:48.812489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9e833-489a-45d1-ba71-b1edef8c93da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:48.813490 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9e833-489a-45d1-ba71-b1edef8c93da None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:48.813992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9e833-489a-45d1-ba71-b1edef8c93da None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:48.814468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9e833-489a-45d1-ba71-b1edef8c93da None admin] PATH_INFO: `/v3/projects/8fa27a3f862749599654d7d59ff48c18` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:48.815929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9e833-489a-45d1-ba71-b1edef8c93da None admin] RBAC: Authorizing `identity:get_project(project_id=8fa27a3f862749599654d7d59ff48c18)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:48.819331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9e833-489a-45d1-ba71-b1edef8c93da None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:48.827209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 211/420] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:48 2022] GET /identity/v3/projects/8fa27a3f862749599654d7d59ff48c18 => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:48.828917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9e833-489a-45d1-ba71-b1edef8c93da None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:48.850560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd316-27d4-47b2-8758-f568b32b6f2f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:48.917913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962334-84f3-4ee3-95ec-c2ea3a7b2144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:48.918540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962334-84f3-4ee3-95ec-c2ea3a7b2144 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:48.918846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962334-84f3-4ee3-95ec-c2ea3a7b2144 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:48.919312 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962334-84f3-4ee3-95ec-c2ea3a7b2144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:48.950672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9e833-489a-45d1-ba71-b1edef8c93da None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:48.984997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:48.992508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a843c13-6e48-447a-83ca-9c9d0f54e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:48.994151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a843c13-6e48-447a-83ca-9c9d0f54e135 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:48.994672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a843c13-6e48-447a-83ca-9c9d0f54e135 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:48.995146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a843c13-6e48-447a-83ca-9c9d0f54e135 None admin] PATH_INFO: `/v3/projects/8fa27a3f862749599654d7d59ff48c18/groups/edb5d94df41b48f8aa8bb4b3536deb68/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:48.997631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a843c13-6e48-447a-83ca-9c9d0f54e135 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fa27a3f862749599654d7d59ff48c18, group_id=edb5d94df41b48f8aa8bb4b3536deb68, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:48.999529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a843c13-6e48-447a-83ca-9c9d0f54e135 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:49.019747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962334-84f3-4ee3-95ec-c2ea3a7b2144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:49.022429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962334-84f3-4ee3-95ec-c2ea3a7b2144 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:49.055022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 212/421] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Sep 1 11:57:48 2022] PUT /identity/v3/projects/8fa27a3f862749599654d7d59ff48c18/groups/edb5d94df41b48f8aa8bb4b3536deb68/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:57:49.056352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a843c13-6e48-447a-83ca-9c9d0f54e135 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:49.097538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:49.204006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 210/422] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:49.206131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735adfd-2953-4522-9c2d-ab5e48ad69e4 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:49.206607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735adfd-2953-4522-9c2d-ab5e48ad69e4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:49.207142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735adfd-2953-4522-9c2d-ab5e48ad69e4 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:49.208714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 211/423] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:49.213402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735adfd-2953-4522-9c2d-ab5e48ad69e4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:49.225448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a843c13-6e48-447a-83ca-9c9d0f54e135 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:49.282246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbb463-8c78-44fd-bcbc-71fe553573b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:49.283038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbb463-8c78-44fd-bcbc-71fe553573b9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:49.283349 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbb463-8c78-44fd-bcbc-71fe553573b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:49.283693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbb463-8c78-44fd-bcbc-71fe553573b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:49.301716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbb463-8c78-44fd-bcbc-71fe553573b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b5fbb463-8c78-44fd-bcbc-71fe553573b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:49.307878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:49.309645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:49.311154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 213/424] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:49.312793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9a5b-02f4-4231-93f7-b7b680458529 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:49.312793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9a5b-02f4-4231-93f7-b7b680458529 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:49.312793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9a5b-02f4-4231-93f7-b7b680458529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:49.336347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e2fb9a5b-02f4-4231-93f7-b7b680458529 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:49.338995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2fb9a5b-02f4-4231-93f7-b7b680458529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:49.385526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735adfd-2953-4522-9c2d-ab5e48ad69e4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:49.429389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47041-bca2-4e81-b7fe-87dba54be976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:49.430358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47041-bca2-4e81-b7fe-87dba54be976 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:49.430358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47041-bca2-4e81-b7fe-87dba54be976 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:49.430598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47041-bca2-4e81-b7fe-87dba54be976 None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:49.431826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba47041-bca2-4e81-b7fe-87dba54be976 None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:49.433514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba47041-bca2-4e81-b7fe-87dba54be976 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:49.435594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 212/425] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:49 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:49.436513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47041-bca2-4e81-b7fe-87dba54be976 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:49.450485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:49.452001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:49.500239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 214/426] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:49.500239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb9a5b-02f4-4231-93f7-b7b680458529 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:49.573689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47041-bca2-4e81-b7fe-87dba54be976 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:49.641905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd49391-9263-4497-9291-bed5014e67ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:49.642503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd49391-9263-4497-9291-bed5014e67ea None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:49.642793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd49391-9263-4497-9291-bed5014e67ea None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:49.643068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd49391-9263-4497-9291-bed5014e67ea None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:49.643754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd49391-9263-4497-9291-bed5014e67ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:49.644060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd49391-9263-4497-9291-bed5014e67ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:49.650320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd49391-9263-4497-9291-bed5014e67ea None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:49.667861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 213/427] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:49.677348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd49391-9263-4497-9291-bed5014e67ea None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:49.679388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb9a5b-02f4-4231-93f7-b7b680458529 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:49.729881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cca8c-3e39-4e71-9543-e15b11d03290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:49.731363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cca8c-3e39-4e71-9543-e15b11d03290 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:49.731363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cca8c-3e39-4e71-9543-e15b11d03290 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:49.731363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cca8c-3e39-4e71-9543-e15b11d03290 None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:49.733029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cca8c-3e39-4e71-9543-e15b11d03290 None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:49.734518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cca8c-3e39-4e71-9543-e15b11d03290 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:49.736518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 215/428] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:49 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:49.742263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cca8c-3e39-4e71-9543-e15b11d03290 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:49.828733 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:49.840054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd49391-9263-4497-9291-bed5014e67ea None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:49.885866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80491e-46eb-4e6b-9664-2077fe9d211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:49.887219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80491e-46eb-4e6b-9664-2077fe9d211e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:49.887504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80491e-46eb-4e6b-9664-2077fe9d211e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:49.887783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80491e-46eb-4e6b-9664-2077fe9d211e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:49.934441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:50.004289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80491e-46eb-4e6b-9664-2077fe9d211e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:50.005220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cca8c-3e39-4e71-9543-e15b11d03290 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:50.006166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80491e-46eb-4e6b-9664-2077fe9d211e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:50.060764 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d4b57-ba71-4844-a9ec-482cce535ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:50.061872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4b57-ba71-4844-a9ec-482cce535ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:50.062371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4b57-ba71-4844-a9ec-482cce535ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:50.062864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4b57-ba71-4844-a9ec-482cce535ce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:50.064237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d4b57-ba71-4844-a9ec-482cce535ce9 None admin] RBAC: Adding query filter params (group.id=45e72bceb70649bdbe1df00a1eb5fd00, role.id=4a2e97979a4c4cd796f797f81fff095a, scope.project.id=960889d116ab4cb4893fa64b6b0869bb) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:50.064802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d4b57-ba71-4844-a9ec-482cce535ce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:50.067009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d4b57-ba71-4844-a9ec-482cce535ce9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:50.078894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 216/429] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 1 11:57:49 2022] GET /identity/v3/role_assignments?group.id=45e72bceb70649bdbe1df00a1eb5fd00&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 611 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:50.080130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d4b57-ba71-4844-a9ec-482cce535ce9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:50.132619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:50.145981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 214/430] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:50.153003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80491e-46eb-4e6b-9664-2077fe9d211e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:50.300114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80491e-46eb-4e6b-9664-2077fe9d211e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:50.358151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d4b57-ba71-4844-a9ec-482cce535ce9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:50.358788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fd75e-8d22-4ff0-bd70-ffc868511fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:50.359683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd75e-8d22-4ff0-bd70-ffc868511fea None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:50.360178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd75e-8d22-4ff0-bd70-ffc868511fea None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:50.360720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd75e-8d22-4ff0-bd70-ffc868511fea None admin] PATH_INFO: `/v3/projects/960889d116ab4cb4893fa64b6b0869bb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:50.362505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fd75e-8d22-4ff0-bd70-ffc868511fea None admin] RBAC: Authorizing `identity:get_project(project_id=960889d116ab4cb4893fa64b6b0869bb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:50.365328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fd75e-8d22-4ff0-bd70-ffc868511fea None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:50.372550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 215/431] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:50 2022] GET /identity/v3/projects/960889d116ab4cb4893fa64b6b0869bb => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:50.374254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fd75e-8d22-4ff0-bd70-ffc868511fea None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:50.381142 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:50.408157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c625b86-a9d1-4948-9818-e856d448fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:50.408864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c625b86-a9d1-4948-9818-e856d448fda3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:50.409150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c625b86-a9d1-4948-9818-e856d448fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:50.409427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c625b86-a9d1-4948-9818-e856d448fda3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:50.424920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c625b86-a9d1-4948-9818-e856d448fda3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7c625b86-a9d1-4948-9818-e856d448fda3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:50.430580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:50.431554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:50.432767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 217/432] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:50.436598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:50.437974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c625b86-a9d1-4948-9818-e856d448fda3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:50.508582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fd75e-8d22-4ff0-bd70-ffc868511fea None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:50.565500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c588-22e4-4b2a-a5c0-bcb4d64d9f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:50.566067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c588-22e4-4b2a-a5c0-bcb4d64d9f7d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:50.566345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c588-22e4-4b2a-a5c0-bcb4d64d9f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:50.566620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c588-22e4-4b2a-a5c0-bcb4d64d9f7d None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:50.568680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817c588-22e4-4b2a-a5c0-bcb4d64d9f7d None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:50.570622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817c588-22e4-4b2a-a5c0-bcb4d64d9f7d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:50.577616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 216/433] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:50 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:50.581028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c588-22e4-4b2a-a5c0-bcb4d64d9f7d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:50.619845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c625b86-a9d1-4948-9818-e856d448fda3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:50.668896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28bb2b-f752-4668-bf70-25d7613ce9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:50.669492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28bb2b-f752-4668-bf70-25d7613ce9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:50.669780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28bb2b-f752-4668-bf70-25d7613ce9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:50.670059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28bb2b-f752-4668-bf70-25d7613ce9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:50.671266 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28bb2b-f752-4668-bf70-25d7613ce9a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:50.671266 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28bb2b-f752-4668-bf70-25d7613ce9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:50.673749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28bb2b-f752-4668-bf70-25d7613ce9a9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:50.683629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 218/434] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:57:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:50.688329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89794eb-91f1-4f55-92d5-a598bf24f0a3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:50.688826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89794eb-91f1-4f55-92d5-a598bf24f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:50.689197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89794eb-91f1-4f55-92d5-a598bf24f0a3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:50.692071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 219/435] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:50.697789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89794eb-91f1-4f55-92d5-a598bf24f0a3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:50.741122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c588-22e4-4b2a-a5c0-bcb4d64d9f7d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:50.747308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:50.760290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:50.803095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faefb3-1fe2-438c-8be5-d085b53b568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:50.803717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faefb3-1fe2-438c-8be5-d085b53b568a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:50.804033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faefb3-1fe2-438c-8be5-d085b53b568a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:50.804309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faefb3-1fe2-438c-8be5-d085b53b568a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:50.805031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faefb3-1fe2-438c-8be5-d085b53b568a None admin] RBAC: Adding query filter params (group.id=45e72bceb70649bdbe1df00a1eb5fd00, role.id=c76ef09e05ab4b329ff0580b80c56f59, scope.project.id=960889d116ab4cb4893fa64b6b0869bb) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:50.805342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faefb3-1fe2-438c-8be5-d085b53b568a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:50.806874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faefb3-1fe2-438c-8be5-d085b53b568a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:50.813292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 217/436] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 1 11:57:50 2022] GET /identity/v3/role_assignments?group.id=45e72bceb70649bdbe1df00a1eb5fd00&scope.project.id=960889d116ab4cb4893fa64b6b0869bb&role.id=c76ef09e05ab4b329ff0580b80c56f59 => generated 611 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:50.817128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c3940-e5b2-4cb0-a6d4-48ff221543aa None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:50.817128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c3940-e5b2-4cb0-a6d4-48ff221543aa None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:50.817426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c3940-e5b2-4cb0-a6d4-48ff221543aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:50.851488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fd3c3940-e5b2-4cb0-a6d4-48ff221543aa None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:50.853907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fd3c3940-e5b2-4cb0-a6d4-48ff221543aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:50.863045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89794eb-91f1-4f55-92d5-a598bf24f0a3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:50.928152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9624e-77f9-48a9-b8a7-e5d9f5a176e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:50.929520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9624e-77f9-48a9-b8a7-e5d9f5a176e9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:50.930018 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9624e-77f9-48a9-b8a7-e5d9f5a176e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:50.931663 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9624e-77f9-48a9-b8a7-e5d9f5a176e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:50.969249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 218/437] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:51.021282 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9624e-77f9-48a9-b8a7-e5d9f5a176e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:51.022880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9624e-77f9-48a9-b8a7-e5d9f5a176e9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:51.061221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:51.145217 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 220/438] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:51.153483 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c3940-e5b2-4cb0-a6d4-48ff221543aa None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:51.252960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9624e-77f9-48a9-b8a7-e5d9f5a176e9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:51.307000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c3940-e5b2-4cb0-a6d4-48ff221543aa None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:51.310886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:51.351580 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e16cd-c1dc-4e19-a8fc-6075945abfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:51.352268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e16cd-c1dc-4e19-a8fc-6075945abfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:51.352531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e16cd-c1dc-4e19-a8fc-6075945abfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:51.352833 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e16cd-c1dc-4e19-a8fc-6075945abfa4 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:51.354023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e16cd-c1dc-4e19-a8fc-6075945abfa4 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:51.355460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e16cd-c1dc-4e19-a8fc-6075945abfa4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:51.357156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 219/439] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:51 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:51.358349 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21d451-0151-406f-b147-751c22536586 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:51.358627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21d451-0151-406f-b147-751c22536586 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:51.358900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21d451-0151-406f-b147-751c22536586 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:51.360127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 220/440] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:51.363186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21d451-0151-406f-b147-751c22536586 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:51.387337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9624e-77f9-48a9-b8a7-e5d9f5a176e9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:51.432379 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe463e-d970-4911-89bf-8c53b8908a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:51.433112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe463e-d970-4911-89bf-8c53b8908a13 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:51.433559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe463e-d970-4911-89bf-8c53b8908a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:51.433994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe463e-d970-4911-89bf-8c53b8908a13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:51.438532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:51.451353 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe463e-d970-4911-89bf-8c53b8908a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7cbe463e-d970-4911-89bf-8c53b8908a13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:51.459554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:51.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:51.462816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 221/441] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:57:51.464131 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19f5b-884a-4c51-ba6a-1b584ad6ee99 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:51.464631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19f5b-884a-4c51-ba6a-1b584ad6ee99 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:51.465311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19f5b-884a-4c51-ba6a-1b584ad6ee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:51.491642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-44c19f5b-884a-4c51-ba6a-1b584ad6ee99 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:51.493998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-44c19f5b-884a-4c51-ba6a-1b584ad6ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:51.505575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21d451-0151-406f-b147-751c22536586 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:51.546638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221d3f-36ee-4255-8dda-67c6d6742f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:51.547357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221d3f-36ee-4255-8dda-67c6d6742f2b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:51.547694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221d3f-36ee-4255-8dda-67c6d6742f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:51.548360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d221d3f-36ee-4255-8dda-67c6d6742f2b None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:51.549696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221d3f-36ee-4255-8dda-67c6d6742f2b None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:51.551332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d221d3f-36ee-4255-8dda-67c6d6742f2b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:51.553116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 221/442] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:51 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:51.554406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221d3f-36ee-4255-8dda-67c6d6742f2b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:51.578929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 222/443] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:51.580423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19f5b-884a-4c51-ba6a-1b584ad6ee99 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:51.607014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:51.691824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d221d3f-36ee-4255-8dda-67c6d6742f2b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:51.735404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17b23c-0332-45f9-8c31-a3aec6bfffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:51.740273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17b23c-0332-45f9-8c31-a3aec6bfffb2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:51.740273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17b23c-0332-45f9-8c31-a3aec6bfffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:51.740273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17b23c-0332-45f9-8c31-a3aec6bfffb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:51.740273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17b23c-0332-45f9-8c31-a3aec6bfffb2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:51.740273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17b23c-0332-45f9-8c31-a3aec6bfffb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:51.740273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17b23c-0332-45f9-8c31-a3aec6bfffb2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:51.754985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 222/444] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:51.756855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17b23c-0332-45f9-8c31-a3aec6bfffb2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:51.776168 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19f5b-884a-4c51-ba6a-1b584ad6ee99 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:51.808884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:51.825760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02693a-a24a-496d-a60f-27d9fd72bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:51.826724 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02693a-a24a-496d-a60f-27d9fd72bb8c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:51.827162 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02693a-a24a-496d-a60f-27d9fd72bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:51.827602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02693a-a24a-496d-a60f-27d9fd72bb8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:51.828882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02693a-a24a-496d-a60f-27d9fd72bb8c None admin] RBAC: Adding query filter params (group.id=45e72bceb70649bdbe1df00a1eb5fd00, role.id=4a2e97979a4c4cd796f797f81fff095a, scope.project.id=4c832ded083c47aab25b1b28396beea6) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:51.829312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02693a-a24a-496d-a60f-27d9fd72bb8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:51.831346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02693a-a24a-496d-a60f-27d9fd72bb8c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:51.842213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 223/445] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 1 11:57:51 2022] GET /identity/v3/role_assignments?group.id=45e72bceb70649bdbe1df00a1eb5fd00&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=4a2e97979a4c4cd796f797f81fff095a => generated 611 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:51.938037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:51.944246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17b23c-0332-45f9-8c31-a3aec6bfffb2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:51.977561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02693a-a24a-496d-a60f-27d9fd72bb8c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:51.998649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e7ee-6a9e-47c9-93a8-71c6454aa9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:51.999606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e7ee-6a9e-47c9-93a8-71c6454aa9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:52.000066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e7ee-6a9e-47c9-93a8-71c6454aa9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:52.000514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e7ee-6a9e-47c9-93a8-71c6454aa9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:52.111536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719e7ee-6a9e-47c9-93a8-71c6454aa9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:52.114602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719e7ee-6a9e-47c9-93a8-71c6454aa9f8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:52.146360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02693a-a24a-496d-a60f-27d9fd72bb8c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:52.203500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fa263-0161-4e44-899a-2d276eb12b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:52.204438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fa263-0161-4e44-899a-2d276eb12b92 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:52.204914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fa263-0161-4e44-899a-2d276eb12b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:52.205365 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fa263-0161-4e44-899a-2d276eb12b92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:52.226637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fa263-0161-4e44-899a-2d276eb12b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-872fa263-0161-4e44-899a-2d276eb12b92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:52.235800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:52.237396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:52.238847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 224/446] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:57:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:57:52.250424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fa263-0161-4e44-899a-2d276eb12b92 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:52.293156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:52.300084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 223/447] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:57:52.307788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e7ee-6a9e-47c9-93a8-71c6454aa9f8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:52.331294 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:52.399253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fa263-0161-4e44-899a-2d276eb12b92 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:52.445114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e7ee-6a9e-47c9-93a8-71c6454aa9f8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:52.446262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409bd55-88b2-4b34-a93d-25aaecb463d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:52.447236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409bd55-88b2-4b34-a93d-25aaecb463d7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:52.447685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409bd55-88b2-4b34-a93d-25aaecb463d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:52.448127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409bd55-88b2-4b34-a93d-25aaecb463d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:52.449147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409bd55-88b2-4b34-a93d-25aaecb463d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:52.449497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409bd55-88b2-4b34-a93d-25aaecb463d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:52.451839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409bd55-88b2-4b34-a93d-25aaecb463d7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:52.470504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 225/448] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:57:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:52.471987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409bd55-88b2-4b34-a93d-25aaecb463d7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:52.497657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde82cf-2eee-48c2-9eca-b017f55daf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:52.498575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde82cf-2eee-48c2-9eca-b017f55daf56 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:52.499024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde82cf-2eee-48c2-9eca-b017f55daf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:52.499440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde82cf-2eee-48c2-9eca-b017f55daf56 None admin] PATH_INFO: `/v3/projects/4c832ded083c47aab25b1b28396beea6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:52.501339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde82cf-2eee-48c2-9eca-b017f55daf56 None admin] RBAC: Authorizing `identity:get_project(project_id=4c832ded083c47aab25b1b28396beea6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:52.503604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde82cf-2eee-48c2-9eca-b017f55daf56 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:52.512106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 224/449] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:52 2022] GET /identity/v3/projects/4c832ded083c47aab25b1b28396beea6 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:52.513876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde82cf-2eee-48c2-9eca-b017f55daf56 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:52.597220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:52.605038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409bd55-88b2-4b34-a93d-25aaecb463d7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:52.621451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:52.647204 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde82cf-2eee-48c2-9eca-b017f55daf56 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:52.656586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b444ab5-dba9-46c7-8296-96dcc0c479e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:52.657851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b444ab5-dba9-46c7-8296-96dcc0c479e4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:52.658292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b444ab5-dba9-46c7-8296-96dcc0c479e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:52.658565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b444ab5-dba9-46c7-8296-96dcc0c479e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:52.696300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62353aed-3285-4389-9779-230b616a97f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:52.697303 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62353aed-3285-4389-9779-230b616a97f3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:52.697768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62353aed-3285-4389-9779-230b616a97f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:52.698218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62353aed-3285-4389-9779-230b616a97f3 None admin] PATH_INFO: `/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:52.700068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62353aed-3285-4389-9779-230b616a97f3 None admin] RBAC: Authorizing `identity:get_group(group_id=45e72bceb70649bdbe1df00a1eb5fd00)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:52.702613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62353aed-3285-4389-9779-230b616a97f3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:52.705639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 225/450] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:52 2022] GET /identity/v3/groups/45e72bceb70649bdbe1df00a1eb5fd00 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:52.713153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62353aed-3285-4389-9779-230b616a97f3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:52.762821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b444ab5-dba9-46c7-8296-96dcc0c479e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:52.764440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b444ab5-dba9-46c7-8296-96dcc0c479e4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:52.845830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62353aed-3285-4389-9779-230b616a97f3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:52.884534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 226/451] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:57:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 11:57:52.886255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3572-13aa-4fd7-8e7e-75b500599796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:52.886950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3572-13aa-4fd7-8e7e-75b500599796 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:52.887279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3572-13aa-4fd7-8e7e-75b500599796 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:52.887626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3572-13aa-4fd7-8e7e-75b500599796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:52.888520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3572-13aa-4fd7-8e7e-75b500599796 None admin] RBAC: Adding query filter params (group.id=45e72bceb70649bdbe1df00a1eb5fd00, role.id=c76ef09e05ab4b329ff0580b80c56f59, scope.project.id=4c832ded083c47aab25b1b28396beea6) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:52.888887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3572-13aa-4fd7-8e7e-75b500599796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:52.890367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3572-13aa-4fd7-8e7e-75b500599796 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:52.894238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:52.894447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b444ab5-dba9-46c7-8296-96dcc0c479e4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:52.897558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 226/452] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 1 11:57:52 2022] GET /identity/v3/role_assignments?group.id=45e72bceb70649bdbe1df00a1eb5fd00&scope.project.id=4c832ded083c47aab25b1b28396beea6&role.id=c76ef09e05ab4b329ff0580b80c56f59 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:52.918157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:53.029534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b444ab5-dba9-46c7-8296-96dcc0c479e4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:53.074435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf49a5f-6bca-4f21-8bbf-2d525fa718f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:53.075288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf49a5f-6bca-4f21-8bbf-2d525fa718f3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:53.075646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf49a5f-6bca-4f21-8bbf-2d525fa718f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:53.076010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf49a5f-6bca-4f21-8bbf-2d525fa718f3 None admin] PATH_INFO: `/v3/projects/8fa27a3f862749599654d7d59ff48c18` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:53.077831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf49a5f-6bca-4f21-8bbf-2d525fa718f3 None admin] RBAC: Authorizing `identity:get_project(project_id=8fa27a3f862749599654d7d59ff48c18)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:53.080364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf49a5f-6bca-4f21-8bbf-2d525fa718f3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:53.082230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 227/453] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:57:52 2022] GET /identity/v3/projects/8fa27a3f862749599654d7d59ff48c18 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:57:53.089633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3572-13aa-4fd7-8e7e-75b500599796 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:53.220147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3572-13aa-4fd7-8e7e-75b500599796 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:53.264770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770d2b4-8e98-4730-886b-88d3bc793795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:53.265687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d2b4-8e98-4730-886b-88d3bc793795 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:53.266106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d2b4-8e98-4730-886b-88d3bc793795 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:53.266458 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d2b4-8e98-4730-886b-88d3bc793795 None admin] PATH_INFO: `/v3/groups/edb5d94df41b48f8aa8bb4b3536deb68` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:53.267727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770d2b4-8e98-4730-886b-88d3bc793795 None admin] RBAC: Authorizing `identity:get_group(group_id=edb5d94df41b48f8aa8bb4b3536deb68)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:53.270225 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770d2b4-8e98-4730-886b-88d3bc793795 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:53.272949 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 227/454] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Sep 1 11:57:53 2022] GET /identity/v3/groups/edb5d94df41b48f8aa8bb4b3536deb68 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:53.279854 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf49a5f-6bca-4f21-8bbf-2d525fa718f3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:53.365222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:53.386988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf49a5f-6bca-4f21-8bbf-2d525fa718f3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:53.420640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a7f0e-2e19-4e53-8169-950691955f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:53.421243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a7f0e-2e19-4e53-8169-950691955f27 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:53.421517 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a7f0e-2e19-4e53-8169-950691955f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:53.421786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a7f0e-2e19-4e53-8169-950691955f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:53.422515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a7f0e-2e19-4e53-8169-950691955f27 None admin] RBAC: Adding query filter params (group.id=edb5d94df41b48f8aa8bb4b3536deb68, role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=8fa27a3f862749599654d7d59ff48c18) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:53.423073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a7f0e-2e19-4e53-8169-950691955f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:53.424527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a7f0e-2e19-4e53-8169-950691955f27 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:53.430592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 228/455] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Sep 1 11:57:53 2022] GET /identity/v3/role_assignments?group.id=edb5d94df41b48f8aa8bb4b3536deb68&scope.project.id=8fa27a3f862749599654d7d59ff48c18&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:56.105822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203abc40-cac8-4b76-aa68-2f271171389d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:56.106379 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203abc40-cac8-4b76-aa68-2f271171389d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:56.107045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203abc40-cac8-4b76-aa68-2f271171389d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:56.110060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 228/456] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:56.116768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd71bb8-df8f-4839-b283-7232cba15313 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:56.117307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd71bb8-df8f-4839-b283-7232cba15313 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:56.117724 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd71bb8-df8f-4839-b283-7232cba15313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:56.156751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7fd71bb8-df8f-4839-b283-7232cba15313 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:56.158757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7fd71bb8-df8f-4839-b283-7232cba15313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:56.168253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee113-9e04-40aa-97c9-f3966bd4b386 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:56.168863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee113-9e04-40aa-97c9-f3966bd4b386 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:56.169422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee113-9e04-40aa-97c9-f3966bd4b386 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:56.172266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 229/457] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:56.177931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2851e8-3cba-43ae-9346-53069ee74756 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:56.178569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2851e8-3cba-43ae-9346-53069ee74756 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:56.179059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2851e8-3cba-43ae-9346-53069ee74756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:56.233411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-dd2851e8-3cba-43ae-9346-53069ee74756 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:56.234644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-dd2851e8-3cba-43ae-9346-53069ee74756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:56.389548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 229/458] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:56.419056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:56.429138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 230/459] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:56.889995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd71bb8-df8f-4839-b283-7232cba15313 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:57.015595 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2851e8-3cba-43ae-9346-53069ee74756 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:57.056588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:57.144583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd71bb8-df8f-4839-b283-7232cba15313 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:57.205162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2851e8-3cba-43ae-9346-53069ee74756 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:57.211863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf955a-7608-4625-84c0-7117eed50603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:57.212855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf955a-7608-4625-84c0-7117eed50603 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:57.213356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf955a-7608-4625-84c0-7117eed50603 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:57.213841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf955a-7608-4625-84c0-7117eed50603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:57.229841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf955a-7608-4625-84c0-7117eed50603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:57.232606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf955a-7608-4625-84c0-7117eed50603 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:57.262503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92162b4c-56bb-4196-857f-eb1768996122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:57.263542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92162b4c-56bb-4196-857f-eb1768996122 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:57.264038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92162b4c-56bb-4196-857f-eb1768996122 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9fcf955a-7608-4625-84c0-7117eed50603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:57:57.264411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:57.265314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:57:57.266249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:57:57.266249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:57:57.266249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:57.266960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 230/460] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:57.267149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92162b4c-56bb-4196-857f-eb1768996122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:57.269918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20865f6-774e-4c5e-86c3-e8fea8e61291 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:57.270664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20865f6-774e-4c5e-86c3-e8fea8e61291 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:57.271488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20865f6-774e-4c5e-86c3-e8fea8e61291 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:57.274225 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 231/461] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:57.276682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20865f6-774e-4c5e-86c3-e8fea8e61291 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:57.279784 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92162b4c-56bb-4196-857f-eb1768996122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:57.281303 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92162b4c-56bb-4196-857f-eb1768996122 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-92162b4c-56bb-4196-857f-eb1768996122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:57:57.300445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:57.307474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:57:57.309493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:57:57.309493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:57:57.309493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:57.309493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 231/462] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:57.309493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eccdc-4e22-47da-81de-fc56e8d34a4f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:57.309493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eccdc-4e22-47da-81de-fc56e8d34a4f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:57.309493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eccdc-4e22-47da-81de-fc56e8d34a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:57.330881 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-347eccdc-4e22-47da-81de-fc56e8d34a4f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:57.332246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-347eccdc-4e22-47da-81de-fc56e8d34a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:57.381923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:57.405533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 232/463] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:57.406535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eccdc-4e22-47da-81de-fc56e8d34a4f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:57.500014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20865f6-774e-4c5e-86c3-e8fea8e61291 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:57.535291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eccdc-4e22-47da-81de-fc56e8d34a4f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:57.552534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:57.575518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f458e8a-2b74-44bb-95f7-9fd6f20dd659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:57.576156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f458e8a-2b74-44bb-95f7-9fd6f20dd659 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:57.576470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f458e8a-2b74-44bb-95f7-9fd6f20dd659 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:57.576748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f458e8a-2b74-44bb-95f7-9fd6f20dd659 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:57.577527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f458e8a-2b74-44bb-95f7-9fd6f20dd659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:57.577857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f458e8a-2b74-44bb-95f7-9fd6f20dd659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:57.578377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac19df-10fd-427c-9fb7-caa4ce7afc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:57.579277 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f458e8a-2b74-44bb-95f7-9fd6f20dd659 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:57.580089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac19df-10fd-427c-9fb7-caa4ce7afc64 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:57.581063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac19df-10fd-427c-9fb7-caa4ce7afc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:57.581914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac19df-10fd-427c-9fb7-caa4ce7afc64 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:57.583466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac19df-10fd-427c-9fb7-caa4ce7afc64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:57.584432 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac19df-10fd-427c-9fb7-caa4ce7afc64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:57.588267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac19df-10fd-427c-9fb7-caa4ce7afc64 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:57.593831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 233/464] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:57.599767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f458e8a-2b74-44bb-95f7-9fd6f20dd659 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:57.616361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 232/465] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:57.619326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551227d-960f-48fe-8758-b427073693de None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:57.620131 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551227d-960f-48fe-8758-b427073693de None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:57.621086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551227d-960f-48fe-8758-b427073693de None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:57.624177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 233/466] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:57:57.625982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551227d-960f-48fe-8758-b427073693de None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:57.660634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:57.709748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f458e8a-2b74-44bb-95f7-9fd6f20dd659 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:57.749827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a9bf2-0913-4046-845a-9ea3b90ee44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:57.750453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a9bf2-0913-4046-845a-9ea3b90ee44f None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:57.750735 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a9bf2-0913-4046-845a-9ea3b90ee44f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:57.751014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a9bf2-0913-4046-845a-9ea3b90ee44f None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:57.751704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a9bf2-0913-4046-845a-9ea3b90ee44f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:57.753226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a9bf2-0913-4046-845a-9ea3b90ee44f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:57.820527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551227d-960f-48fe-8758-b427073693de None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:57.848264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 234/467] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:57:57 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 11:57:57.848264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456636-cf61-4d0d-8323-1f069e9a0e99 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:57.848264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456636-cf61-4d0d-8323-1f069e9a0e99 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:57.848264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456636-cf61-4d0d-8323-1f069e9a0e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:57.878391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-12456636-cf61-4d0d-8323-1f069e9a0e99 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:57.879747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-12456636-cf61-4d0d-8323-1f069e9a0e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:57.904168 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749066bd-7c6a-4720-b24c-d3ba84c26140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:57.904818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749066bd-7c6a-4720-b24c-d3ba84c26140 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:57.905102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749066bd-7c6a-4720-b24c-d3ba84c26140 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:57.905361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749066bd-7c6a-4720-b24c-d3ba84c26140 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:57.906027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749066bd-7c6a-4720-b24c-d3ba84c26140 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:57.907637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749066bd-7c6a-4720-b24c-d3ba84c26140 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:57.976059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 234/468] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:57:57 2022] POST /identity/v3/users => generated 246 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:57:57.977039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749066bd-7c6a-4720-b24c-d3ba84c26140 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:58.070838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 235/469] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:57:58.089632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57bf32-c2db-4ed8-9ec1-9b323215eba3 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:58.089899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57bf32-c2db-4ed8-9ec1-9b323215eba3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:58.090194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57bf32-c2db-4ed8-9ec1-9b323215eba3 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:58.091928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 236/470] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:57:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:57:58.098380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:58.099785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8717-0cb0-4705-b5ac-5cbb0ca9a65e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:58.099952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8717-0cb0-4705-b5ac-5cbb0ca9a65e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:58.100257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8717-0cb0-4705-b5ac-5cbb0ca9a65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:58.135194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-302a8717-0cb0-4705-b5ac-5cbb0ca9a65e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:57:58.136898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-302a8717-0cb0-4705-b5ac-5cbb0ca9a65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:57:58.170240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:58.210055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749066bd-7c6a-4720-b24c-d3ba84c26140 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:58.256245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 237/471] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:57:58.268891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2862fd-0f85-4b25-81c0-51d2e9c74b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:58.269953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2862fd-0f85-4b25-81c0-51d2e9c74b46 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:58.270453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2862fd-0f85-4b25-81c0-51d2e9c74b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:58.270930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2862fd-0f85-4b25-81c0-51d2e9c74b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:58.295374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2862fd-0f85-4b25-81c0-51d2e9c74b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:58.297271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2862fd-0f85-4b25-81c0-51d2e9c74b46 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7f2862fd-0f85-4b25-81c0-51d2e9c74b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:57:58.328054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:58.329831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:57:58.331512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:57:58.331512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:57:58.331512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:58.334776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 235/472] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:58.343793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8717-0cb0-4705-b5ac-5cbb0ca9a65e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:58.501359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8717-0cb0-4705-b5ac-5cbb0ca9a65e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:58.549983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2862fd-0f85-4b25-81c0-51d2e9c74b46 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:58.559981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858bfe3-0996-4490-b5c1-1a5afa93e90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:58.560643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858bfe3-0996-4490-b5c1-1a5afa93e90d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:58.560919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858bfe3-0996-4490-b5c1-1a5afa93e90d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:58.561225 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858bfe3-0996-4490-b5c1-1a5afa93e90d None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:58.561855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858bfe3-0996-4490-b5c1-1a5afa93e90d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:58.562165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858bfe3-0996-4490-b5c1-1a5afa93e90d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:58.563566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858bfe3-0996-4490-b5c1-1a5afa93e90d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:58.577061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 238/473] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:58.584911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858bfe3-0996-4490-b5c1-1a5afa93e90d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:58.607717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:58.734725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858bfe3-0996-4490-b5c1-1a5afa93e90d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:58.783997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f356a-ccb4-4461-b8c5-7abc74438301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:58.785057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f356a-ccb4-4461-b8c5-7abc74438301 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:58.785341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f356a-ccb4-4461-b8c5-7abc74438301 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:58.785713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f356a-ccb4-4461-b8c5-7abc74438301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:58.788197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:58.800077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f356a-ccb4-4461-b8c5-7abc74438301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:58.801595 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f356a-ccb4-4461-b8c5-7abc74438301 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:58.813747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2862fd-0f85-4b25-81c0-51d2e9c74b46 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-2f0f356a-ccb4-4461-b8c5-7abc74438301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:57:58.824026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:58.825171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:57:58.826232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:57:58.826232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:57:58.826232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:58.826232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 239/474] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:58.826232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f356a-ccb4-4461-b8c5-7abc74438301 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:58.897558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f993f-8042-45c6-82d1-655c2f106d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:58.898479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f993f-8042-45c6-82d1-655c2f106d82 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:58.898926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f993f-8042-45c6-82d1-655c2f106d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:58.899393 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f993f-8042-45c6-82d1-655c2f106d82 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:58.900323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f993f-8042-45c6-82d1-655c2f106d82 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:58.902173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f993f-8042-45c6-82d1-655c2f106d82 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:58.938697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:58.949296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.sql.core [None req-575f993f-8042-45c6-82d1-655c2f106d82 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 11:57:58.949296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 11:57:58.949296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [parameters: {'id': '95a7457fec3a41a4b54015aa01c6c3ea', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 11:57:58.949296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81863) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-575f993f-8042-45c6-82d1-655c2f106d82 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application conn.query(q) Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result.read() Sep 01 11:57:58.978732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 11:57:58.979712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application next(self.gen) Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application yield resource Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application next(self.gen) Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise self.value Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application session.commit() Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 11:57:58.980731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.session.flush() Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application compat.raise_( Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 11:57:58.981606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 11:57:58.982492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application conn.query(q) Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result.read() Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 11:57:58.983369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [parameters: {'id': '95a7457fec3a41a4b54015aa01c6c3ea', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:58.985187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 11:57:58.987006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:57:58.995084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 236/475] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Sep 1 11:57:58 2022] POST /identity/v3/roles => generated 144 bytes in 444 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:58.995084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f993f-8042-45c6-82d1-655c2f106d82 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:59.011012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f356a-ccb4-4461-b8c5-7abc74438301 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:59.052081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426a366-3ebb-4a8f-8c34-6c879bdf27ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:59.053262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426a366-3ebb-4a8f-8c34-6c879bdf27ff None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:59.053866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426a366-3ebb-4a8f-8c34-6c879bdf27ff None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:59.054342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426a366-3ebb-4a8f-8c34-6c879bdf27ff None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:59.055208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426a366-3ebb-4a8f-8c34-6c879bdf27ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:59.056997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426a366-3ebb-4a8f-8c34-6c879bdf27ff None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:59.186985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f993f-8042-45c6-82d1-655c2f106d82 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:59.209082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 240/476] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:57:58 2022] POST /identity/v3/users => generated 248 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:57:59.209747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426a366-3ebb-4a8f-8c34-6c879bdf27ff None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:59.309546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ffd55-5114-423a-be0a-546ee9e6eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:59.310661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffd55-5114-423a-be0a-546ee9e6eb91 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:59.311167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffd55-5114-423a-be0a-546ee9e6eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:59.311759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ffd55-5114-423a-be0a-546ee9e6eb91 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:59.312976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ffd55-5114-423a-be0a-546ee9e6eb91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:59.313622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ffd55-5114-423a-be0a-546ee9e6eb91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:59.316178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ffd55-5114-423a-be0a-546ee9e6eb91 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:59.356752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 237/477] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:57:59.361903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ffd55-5114-423a-be0a-546ee9e6eb91 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:59.399663 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:59.501061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426a366-3ebb-4a8f-8c34-6c879bdf27ff None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:59.560618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:57:59.574023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700a08-8308-4c05-85bb-dd54c31c28ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:59.576173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700a08-8308-4c05-85bb-dd54c31c28ac None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:59.580261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700a08-8308-4c05-85bb-dd54c31c28ac None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:59.580261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700a08-8308-4c05-85bb-dd54c31c28ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:59.583578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ffd55-5114-423a-be0a-546ee9e6eb91 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:59.598755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69700a08-8308-4c05-85bb-dd54c31c28ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-69700a08-8308-4c05-85bb-dd54c31c28ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:57:59.604895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:57:59.610149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:57:59.611750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 241/478] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:57:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:57:59.623418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700a08-8308-4c05-85bb-dd54c31c28ac None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:57:59.667039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76acc-3280-4431-9632-d1ef3f04124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:59.668012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76acc-3280-4431-9632-d1ef3f04124b None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:59.668537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76acc-3280-4431-9632-d1ef3f04124b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:59.669022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76acc-3280-4431-9632-d1ef3f04124b None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:59.670204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed76acc-3280-4431-9632-d1ef3f04124b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:59.673650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed76acc-3280-4431-9632-d1ef3f04124b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:59.793265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 238/479] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:57:59 2022] POST /identity/v3/users => generated 249 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:57:59.830501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700a08-8308-4c05-85bb-dd54c31c28ac None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:57:59.899197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a9344-3cc1-4980-a536-b087b22d9cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:57:59.900589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a9344-3cc1-4980-a536-b087b22d9cec None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:57:59.901073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a9344-3cc1-4980-a536-b087b22d9cec None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:57:59.901557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a9344-3cc1-4980-a536-b087b22d9cec None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:57:59.902781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a9344-3cc1-4980-a536-b087b22d9cec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:57:59.903308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a9344-3cc1-4980-a536-b087b22d9cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:57:59.905856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a9344-3cc1-4980-a536-b087b22d9cec None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:57:59.925626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 242/480] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:57:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:00.593010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d48a-72b4-4ae0-a67f-d6987b911554 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:00.593552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d48a-72b4-4ae0-a67f-d6987b911554 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:00.593991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d48a-72b4-4ae0-a67f-d6987b911554 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:00.596677 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 239/481] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:00.608028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f962c-d3ba-4333-bed6-b0634a08c7e7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:00.608612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f962c-d3ba-4333-bed6-b0634a08c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:00.608929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f962c-d3ba-4333-bed6-b0634a08c7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:00.642861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-730f962c-d3ba-4333-bed6-b0634a08c7e7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:00.644642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-730f962c-d3ba-4333-bed6-b0634a08c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:00.759991 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:00.832324 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 243/482] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:01.278216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d48a-72b4-4ae0-a67f-d6987b911554 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:01.387103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:01.402616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839735c-8fa6-4eb0-842b-c976438e4a6c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:01.403091 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839735c-8fa6-4eb0-842b-c976438e4a6c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:01.403637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839735c-8fa6-4eb0-842b-c976438e4a6c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:01.406752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 244/483] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:01.416043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe1de1-b3be-491f-b826-9edc681d4e83 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:01.416669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe1de1-b3be-491f-b826-9edc681d4e83 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:01.417162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe1de1-b3be-491f-b826-9edc681d4e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:01.450194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d48a-72b4-4ae0-a67f-d6987b911554 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:01.464334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3cbe1de1-b3be-491f-b826-9edc681d4e83 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:01.466761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3cbe1de1-b3be-491f-b826-9edc681d4e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:01.624423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263553c-c6f9-4d4b-a5cf-a4a76bd3860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:01.625136 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263553c-c6f9-4d4b-a5cf-a4a76bd3860d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:01.628231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263553c-c6f9-4d4b-a5cf-a4a76bd3860d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:01.628231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263553c-c6f9-4d4b-a5cf-a4a76bd3860d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:01.666694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263553c-c6f9-4d4b-a5cf-a4a76bd3860d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e263553c-c6f9-4d4b-a5cf-a4a76bd3860d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:01.688241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:01.689243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:01.690502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:01.693373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 240/484] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:01.701244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263553c-c6f9-4d4b-a5cf-a4a76bd3860d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:01.772062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 245/485] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:01.946256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263553c-c6f9-4d4b-a5cf-a4a76bd3860d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:01.990670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:02.002419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557868f-62e1-4d71-9155-1a0d4823ad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:02.003380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557868f-62e1-4d71-9155-1a0d4823ad07 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:02.003857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557868f-62e1-4d71-9155-1a0d4823ad07 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:02.004451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557868f-62e1-4d71-9155-1a0d4823ad07 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:02.005351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557868f-62e1-4d71-9155-1a0d4823ad07 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:02.005852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557868f-62e1-4d71-9155-1a0d4823ad07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:02.007422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557868f-62e1-4d71-9155-1a0d4823ad07 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:02.020651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 241/486] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:02.027213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe1de1-b3be-491f-b826-9edc681d4e83 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:02.154738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557868f-62e1-4d71-9155-1a0d4823ad07 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:02.206515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe1de1-b3be-491f-b826-9edc681d4e83 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:02.216477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:02.272193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebecfa-5443-451a-8615-14334302c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:02.273294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebecfa-5443-451a-8615-14334302c45a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:02.273786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebecfa-5443-451a-8615-14334302c45a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:02.274934 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebecfa-5443-451a-8615-14334302c45a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:02.294742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebecfa-5443-451a-8615-14334302c45a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:02.297726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebecfa-5443-451a-8615-14334302c45a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-92ebecfa-5443-451a-8615-14334302c45a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:02.327902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:02.328871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:02.329695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:02.329695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:02.329695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:02.330339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 246/487] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:02.338823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebecfa-5443-451a-8615-14334302c45a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:02.434700 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557868f-62e1-4d71-9155-1a0d4823ad07 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:02.530846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3931e-a5e8-4e21-a0ea-eeba0e036aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:02.532242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3931e-a5e8-4e21-a0ea-eeba0e036aef None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:02.532859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3931e-a5e8-4e21-a0ea-eeba0e036aef None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:02.533676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3931e-a5e8-4e21-a0ea-eeba0e036aef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:02.552593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebecfa-5443-451a-8615-14334302c45a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:02.573685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3931e-a5e8-4e21-a0ea-eeba0e036aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a1b3931e-a5e8-4e21-a0ea-eeba0e036aef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:02.583211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:02.585016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:02.586920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:02.593696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 242/488] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:02.606290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3931e-a5e8-4e21-a0ea-eeba0e036aef None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:02.626706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5a8f1-0ea2-4594-b1af-9830fa007273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:02.627792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5a8f1-0ea2-4594-b1af-9830fa007273 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:02.628268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5a8f1-0ea2-4594-b1af-9830fa007273 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:02.628722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5a8f1-0ea2-4594-b1af-9830fa007273 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:02.629815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5a8f1-0ea2-4594-b1af-9830fa007273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:02.630308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5a8f1-0ea2-4594-b1af-9830fa007273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:02.632926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5a8f1-0ea2-4594-b1af-9830fa007273 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:02.658757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 247/489] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:02.667803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5a8f1-0ea2-4594-b1af-9830fa007273 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:02.703215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:02.777259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:02.837969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3931e-a5e8-4e21-a0ea-eeba0e036aef None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:02.853497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5a8f1-0ea2-4594-b1af-9830fa007273 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:02.877067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464cec5-886b-4a09-a8a3-8b67822ac638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:02.877699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464cec5-886b-4a09-a8a3-8b67822ac638 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:02.877987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464cec5-886b-4a09-a8a3-8b67822ac638 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:02.878374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464cec5-886b-4a09-a8a3-8b67822ac638 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:02.879176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464cec5-886b-4a09-a8a3-8b67822ac638 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:02.879498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464cec5-886b-4a09-a8a3-8b67822ac638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:02.881052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464cec5-886b-4a09-a8a3-8b67822ac638 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:02.891279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e1c13-c8f8-48a4-ab77-d468f55caeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:02.891685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 243/490] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:02.891929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e1c13-c8f8-48a4-ab77-d468f55caeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:02.892234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e1c13-c8f8-48a4-ab77-d468f55caeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:02.892505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e1c13-c8f8-48a4-ab77-d468f55caeb6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:02.893091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bafe95-4603-44ee-a095-680ba3ebf8a8 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:02.893434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bafe95-4603-44ee-a095-680ba3ebf8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:02.893720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bafe95-4603-44ee-a095-680ba3ebf8a8 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:02.895408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 244/491] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:02.901415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e1c13-c8f8-48a4-ab77-d468f55caeb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:02.901806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ceed5b-2406-4beb-aa76-643fc4fd0c75 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:02.902097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ceed5b-2406-4beb-aa76-643fc4fd0c75 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:02.902377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ceed5b-2406-4beb-aa76-643fc4fd0c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:02.902886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e1c13-c8f8-48a4-ab77-d468f55caeb6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-270e1c13-c8f8-48a4-ab77-d468f55caeb6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:02.917767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:02.918740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 248/492] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:02.920101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e1c13-c8f8-48a4-ab77-d468f55caeb6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:02.922642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-86ceed5b-2406-4beb-aa76-643fc4fd0c75 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:02.924055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-86ceed5b-2406-4beb-aa76-643fc4fd0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:03.008199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 245/493] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:03.010001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ceed5b-2406-4beb-aa76-643fc4fd0c75 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:03.037448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:03.080834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e1c13-c8f8-48a4-ab77-d468f55caeb6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:03.092847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:03.148550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14490-d57e-4437-bd70-4d3c52c17aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:03.150172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14490-d57e-4437-bd70-4d3c52c17aab None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:03.151085 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14490-d57e-4437-bd70-4d3c52c17aab None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:03.151262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14490-d57e-4437-bd70-4d3c52c17aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:03.171948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c14490-d57e-4437-bd70-4d3c52c17aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:03.174777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c14490-d57e-4437-bd70-4d3c52c17aab None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:03.197159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ceed5b-2406-4beb-aa76-643fc4fd0c75 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-00c14490-d57e-4437-bd70-4d3c52c17aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:03.207507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:03.208889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:03.210456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:03.210456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:03.210456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:03.214166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 249/494] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:03.216891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7bc9e-e8cd-4e0e-8137-41186ccba1ec None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:03.218173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7bc9e-e8cd-4e0e-8137-41186ccba1ec None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:03.219300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7bc9e-e8cd-4e0e-8137-41186ccba1ec None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:03.228445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 250/495] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:03.229399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7bc9e-e8cd-4e0e-8137-41186ccba1ec None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:03.269580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c4bda-9a05-4d40-895a-d842d8712fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:03.271914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c4bda-9a05-4d40-895a-d842d8712fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:03.272992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c4bda-9a05-4d40-895a-d842d8712fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:03.273688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c4bda-9a05-4d40-895a-d842d8712fa5 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:03.276529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c4bda-9a05-4d40-895a-d842d8712fa5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:03.277531 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c4bda-9a05-4d40-895a-d842d8712fa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:03.281421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c4bda-9a05-4d40-895a-d842d8712fa5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:03.340070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 246/496] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 1 11:58:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:03.342352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc244ef3-598e-42f7-8cfb-9608c7dbcf66 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:03.342760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc244ef3-598e-42f7-8cfb-9608c7dbcf66 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:03.343111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc244ef3-598e-42f7-8cfb-9608c7dbcf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:03.369417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bc244ef3-598e-42f7-8cfb-9608c7dbcf66 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:03.370875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bc244ef3-598e-42f7-8cfb-9608c7dbcf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:03.386596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7bc9e-e8cd-4e0e-8137-41186ccba1ec None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:03.421933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:03.440904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e39055-eb1a-4b5d-98af-f0205f658843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:03.441556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e39055-eb1a-4b5d-98af-f0205f658843 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:03.447920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e39055-eb1a-4b5d-98af-f0205f658843 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:03.447920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e39055-eb1a-4b5d-98af-f0205f658843 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:03.447920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e39055-eb1a-4b5d-98af-f0205f658843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:03.447920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e39055-eb1a-4b5d-98af-f0205f658843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:03.447920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e39055-eb1a-4b5d-98af-f0205f658843 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:03.462330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 251/497] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:03.462330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e39055-eb1a-4b5d-98af-f0205f658843 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:03.482155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 247/498] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:03.483039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc244ef3-598e-42f7-8cfb-9608c7dbcf66 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:03.533399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:03.620456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc244ef3-598e-42f7-8cfb-9608c7dbcf66 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:03.637135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e39055-eb1a-4b5d-98af-f0205f658843 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:03.676501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fafb7-6793-4b0d-9623-337bd16b6040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:03.677455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fafb7-6793-4b0d-9623-337bd16b6040 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:03.677888 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fafb7-6793-4b0d-9623-337bd16b6040 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:03.678342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fafb7-6793-4b0d-9623-337bd16b6040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:03.680123 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9a810-5d7c-4ba7-ae7b-6e70d00f8223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:03.681252 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9a810-5d7c-4ba7-ae7b-6e70d00f8223 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:03.681530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9a810-5d7c-4ba7-ae7b-6e70d00f8223 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:03.681802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9a810-5d7c-4ba7-ae7b-6e70d00f8223 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:03.694192 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9a810-5d7c-4ba7-ae7b-6e70d00f8223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f5d9a810-5d7c-4ba7-ae7b-6e70d00f8223 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:03.699816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:03.701630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 252/499] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:03.703825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcfc10-170e-4e68-b461-74443d752e68 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:03.706356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcfc10-170e-4e68-b461-74443d752e68 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:03.706356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcfc10-170e-4e68-b461-74443d752e68 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:03.706356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 253/500] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:03.706356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcfc10-170e-4e68-b461-74443d752e68 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:03.768661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:03.785968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fafb7-6793-4b0d-9623-337bd16b6040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:03.787559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fafb7-6793-4b0d-9623-337bd16b6040 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:03.835321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcfc10-170e-4e68-b461-74443d752e68 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:03.835609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:03.874215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870fc30-e18e-47d8-9529-fa70354392f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:03.875293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870fc30-e18e-47d8-9529-fa70354392f1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:03.875713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870fc30-e18e-47d8-9529-fa70354392f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:03.876244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870fc30-e18e-47d8-9529-fa70354392f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:03.891507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870fc30-e18e-47d8-9529-fa70354392f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:03.894298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870fc30-e18e-47d8-9529-fa70354392f1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a870fc30-e18e-47d8-9529-fa70354392f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:03.916051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:03.917254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:03.918314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 254/501] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 1 11:58:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:03.919657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870fc30-e18e-47d8-9529-fa70354392f1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:03.933919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 248/502] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:03.935216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292f5a-3b4e-41ee-9eba-f8613c490be5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:03.935501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292f5a-3b4e-41ee-9eba-f8613c490be5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:03.935778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292f5a-3b4e-41ee-9eba-f8613c490be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:03.956846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-67292f5a-3b4e-41ee-9eba-f8613c490be5 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:03.958105 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-67292f5a-3b4e-41ee-9eba-f8613c490be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:04.035409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 249/503] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:04.036412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67292f5a-3b4e-41ee-9eba-f8613c490be5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:04.054120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870fc30-e18e-47d8-9529-fa70354392f1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:04.068993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:04.095850 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6626fa-45e0-43c3-a788-fa98960ce240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:04.096507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6626fa-45e0-43c3-a788-fa98960ce240 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:04.096895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6626fa-45e0-43c3-a788-fa98960ce240 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:04.097542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6626fa-45e0-43c3-a788-fa98960ce240 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:04.097806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6626fa-45e0-43c3-a788-fa98960ce240 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:04.098111 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6626fa-45e0-43c3-a788-fa98960ce240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:04.099496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6626fa-45e0-43c3-a788-fa98960ce240 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:04.114879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 255/504] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:04.115920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6626fa-45e0-43c3-a788-fa98960ce240 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:04.126278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:04.199329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67292f5a-3b4e-41ee-9eba-f8613c490be5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:04.236245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6626fa-45e0-43c3-a788-fa98960ce240 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:04.267303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02169-6dee-4671-86dc-c0bd07ae5653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:04.268413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02169-6dee-4671-86dc-c0bd07ae5653 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:04.268909 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02169-6dee-4671-86dc-c0bd07ae5653 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:04.269391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02169-6dee-4671-86dc-c0bd07ae5653 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:04.270702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad02169-6dee-4671-86dc-c0bd07ae5653 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:04.271234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad02169-6dee-4671-86dc-c0bd07ae5653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:04.274051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad02169-6dee-4671-86dc-c0bd07ae5653 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:04.301097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5fb96-7355-4bb2-9724-a5a6d567b776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:04.302470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5fb96-7355-4bb2-9724-a5a6d567b776 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:04.303191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5fb96-7355-4bb2-9724-a5a6d567b776 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:04.303851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5fb96-7355-4bb2-9724-a5a6d567b776 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:04.308028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 250/505] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 1 11:58:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:04.309564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02169-6dee-4671-86dc-c0bd07ae5653 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:04.328785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5fb96-7355-4bb2-9724-a5a6d567b776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-06e5fb96-7355-4bb2-9724-a5a6d567b776 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:04.339397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:04.341447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:04.343382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:04.354304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 256/506] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:04.354304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5fb96-7355-4bb2-9724-a5a6d567b776 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:04.390654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:04.476106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5fb96-7355-4bb2-9724-a5a6d567b776 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:04.494704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02169-6dee-4671-86dc-c0bd07ae5653 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:04.520651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775e8c-ce04-4757-9d26-10ce85688023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:04.521425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775e8c-ce04-4757-9d26-10ce85688023 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:04.521843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775e8c-ce04-4757-9d26-10ce85688023 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:04.522141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775e8c-ce04-4757-9d26-10ce85688023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:04.526208 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:04.535693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4775e8c-ce04-4757-9d26-10ce85688023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:04.537435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4775e8c-ce04-4757-9d26-10ce85688023 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:04.539834 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9864044-560a-442d-bd40-89a3a653a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:04.540532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9864044-560a-442d-bd40-89a3a653a538 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:04.540817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9864044-560a-442d-bd40-89a3a653a538 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:04.541100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9864044-560a-442d-bd40-89a3a653a538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:04.553222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9864044-560a-442d-bd40-89a3a653a538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:04.554690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9864044-560a-442d-bd40-89a3a653a538 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f4775e8c-ce04-4757-9d26-10ce85688023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:04.555758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:04.557432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:04.559112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:04.559112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:04.559112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:04.559112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 257/507] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:04.559112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775e8c-ce04-4757-9d26-10ce85688023 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a9864044-560a-442d-bd40-89a3a653a538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:04.577637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:04.579629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:04.581676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:04.581676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:04.581676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:04.581676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 251/508] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:04.581676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9864044-560a-442d-bd40-89a3a653a538 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:04.698119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:04.709125 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9864044-560a-442d-bd40-89a3a653a538 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:04.721635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775e8c-ce04-4757-9d26-10ce85688023 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:04.759630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b8ab-8950-4d03-9bf0-60542e7dc9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:04.760444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b8ab-8950-4d03-9bf0-60542e7dc9ae None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:04.760725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b8ab-8950-4d03-9bf0-60542e7dc9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:04.761149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b8ab-8950-4d03-9bf0-60542e7dc9ae None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:04.761726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b8ab-8950-4d03-9bf0-60542e7dc9ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:04.762037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b8ab-8950-4d03-9bf0-60542e7dc9ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:04.763490 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b8ab-8950-4d03-9bf0-60542e7dc9ae None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:04.772343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699328d8-9388-48ca-9bbe-5cd94a23396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:04.773117 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699328d8-9388-48ca-9bbe-5cd94a23396d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:04.773520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699328d8-9388-48ca-9bbe-5cd94a23396d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:04.773763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 252/509] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:04.774557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699328d8-9388-48ca-9bbe-5cd94a23396d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:04.775093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b8ab-8950-4d03-9bf0-60542e7dc9ae None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:04.818670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:04.889179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699328d8-9388-48ca-9bbe-5cd94a23396d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:04.891256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699328d8-9388-48ca-9bbe-5cd94a23396d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:04.897409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b8ab-8950-4d03-9bf0-60542e7dc9ae None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:04.936680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade7f3-eee5-42e0-81fa-22a345ded2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:04.937332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade7f3-eee5-42e0-81fa-22a345ded2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:04.937615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade7f3-eee5-42e0-81fa-22a345ded2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:04.937892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade7f3-eee5-42e0-81fa-22a345ded2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:04.948989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ade7f3-eee5-42e0-81fa-22a345ded2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:04.950373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ade7f3-eee5-42e0-81fa-22a345ded2a6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c1ade7f3-eee5-42e0-81fa-22a345ded2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:04.966221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:04.967194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:04.968035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:04.968035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:04.968035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:04.968035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 253/510] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:04.968307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade7f3-eee5-42e0-81fa-22a345ded2a6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:05.014641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:05.040483 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 258/511] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:05.040483 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699328d8-9388-48ca-9bbe-5cd94a23396d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:05.080924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:05.094080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade7f3-eee5-42e0-81fa-22a345ded2a6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:05.134770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1619-8441-4d4a-8945-61136d1eb6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:05.135576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1619-8441-4d4a-8945-61136d1eb6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:05.135932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1619-8441-4d4a-8945-61136d1eb6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:05.136334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1619-8441-4d4a-8945-61136d1eb6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:05.137107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b1619-8441-4d4a-8945-61136d1eb6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:05.137556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b1619-8441-4d4a-8945-61136d1eb6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:05.139016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b1619-8441-4d4a-8945-61136d1eb6a9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:05.152670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 254/512] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:05.153771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1619-8441-4d4a-8945-61136d1eb6a9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:05.171080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699328d8-9388-48ca-9bbe-5cd94a23396d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:05.225460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147cea9-a115-4f16-a824-27cd1008961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:05.226420 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147cea9-a115-4f16-a824-27cd1008961c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:05.226906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147cea9-a115-4f16-a824-27cd1008961c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:05.227384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147cea9-a115-4f16-a824-27cd1008961c None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:05.228574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147cea9-a115-4f16-a824-27cd1008961c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:05.229100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147cea9-a115-4f16-a824-27cd1008961c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:05.231669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147cea9-a115-4f16-a824-27cd1008961c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:05.248327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 259/513] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:05.249644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147cea9-a115-4f16-a824-27cd1008961c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:05.281534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1619-8441-4d4a-8945-61136d1eb6a9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:05.301626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:05.342812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4043b-2073-472d-88b6-bdb2e29fb3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:05.343859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4043b-2073-472d-88b6-bdb2e29fb3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:05.344355 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4043b-2073-472d-88b6-bdb2e29fb3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:05.344838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4043b-2073-472d-88b6-bdb2e29fb3d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:05.362258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147cea9-a115-4f16-a824-27cd1008961c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:05.364808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4043b-2073-472d-88b6-bdb2e29fb3d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:05.368284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4043b-2073-472d-88b6-bdb2e29fb3d7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:05.384334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-68b4043b-2073-472d-88b6-bdb2e29fb3d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:05.396040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:05.400103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:05.401762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:05.401762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:05.401762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:05.401762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 255/514] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:05.401762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4043b-2073-472d-88b6-bdb2e29fb3d7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:05.404974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0968c-863c-465f-8919-55da85bef823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:05.405605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0968c-863c-465f-8919-55da85bef823 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:05.405883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0968c-863c-465f-8919-55da85bef823 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:05.406161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0968c-863c-465f-8919-55da85bef823 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:05.406822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0968c-863c-465f-8919-55da85bef823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:05.407132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0968c-863c-465f-8919-55da85bef823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:05.408552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0968c-863c-465f-8919-55da85bef823 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:05.421870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 260/515] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:05.423020 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0968c-863c-465f-8919-55da85bef823 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:05.548761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4043b-2073-472d-88b6-bdb2e29fb3d7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:05.565290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0968c-863c-465f-8919-55da85bef823 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:05.570278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:05.601558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7060b95-5d93-4099-a80f-ab1bbcd0c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:05.602899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7060b95-5d93-4099-a80f-ab1bbcd0c695 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:05.603284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7060b95-5d93-4099-a80f-ab1bbcd0c695 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:05.603649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7060b95-5d93-4099-a80f-ab1bbcd0c695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:05.615820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f48ee-e5e4-4fc4-9cef-7117959d2e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:05.616483 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f48ee-e5e4-4fc4-9cef-7117959d2e5d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:05.616758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f48ee-e5e4-4fc4-9cef-7117959d2e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:05.617026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f48ee-e5e4-4fc4-9cef-7117959d2e5d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:05.617661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7060b95-5d93-4099-a80f-ab1bbcd0c695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:05.619327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7060b95-5d93-4099-a80f-ab1bbcd0c695 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:05.625261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f48ee-e5e4-4fc4-9cef-7117959d2e5d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:05.626737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f48ee-e5e4-4fc4-9cef-7117959d2e5d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e7060b95-5d93-4099-a80f-ab1bbcd0c695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:05.637186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:05.639103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:05.641578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:05.641578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:05.641578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:05.641578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 256/516] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a31f48ee-e5e4-4fc4-9cef-7117959d2e5d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:05.642224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:05.645022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:05.647797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:05.647797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:05.647797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:05.647797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:05.647797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:05.647797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:05.647797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:05.647797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:05.647797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 11:58:05.647797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:05.649529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7060b95-5d93-4099-a80f-ab1bbcd0c695 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:05.649677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 261/517] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:05.649677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f48ee-e5e4-4fc4-9cef-7117959d2e5d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:05.724116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:05.779971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7060b95-5d93-4099-a80f-ab1bbcd0c695 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:05.797474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f48ee-e5e4-4fc4-9cef-7117959d2e5d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:05.817274 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e632-fca5-438d-9355-6c3d567d0c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:05.817956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e632-fca5-438d-9355-6c3d567d0c5a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:05.818300 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e632-fca5-438d-9355-6c3d567d0c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:05.818630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e632-fca5-438d-9355-6c3d567d0c5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:05.830206 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9e632-fca5-438d-9355-6c3d567d0c5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:05.833121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9e632-fca5-438d-9355-6c3d567d0c5a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:05.846467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d981-b97e-447d-9743-3a5b24dd47ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:05.847077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d981-b97e-447d-9743-3a5b24dd47ac None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:05.847350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d981-b97e-447d-9743-3a5b24dd47ac None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:05.847620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d981-b97e-447d-9743-3a5b24dd47ac None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:05.848297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911d981-b97e-447d-9743-3a5b24dd47ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:05.848599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911d981-b97e-447d-9743-3a5b24dd47ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:05.849973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911d981-b97e-447d-9743-3a5b24dd47ac None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7ae9e632-fca5-438d-9355-6c3d567d0c5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:05.858145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:05.859606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:05.861071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:05.861071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:05.861071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:05.861071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:05.861071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:05.861071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:05.861071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:05.861071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:05.861071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 257/518] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:05.862145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e632-fca5-438d-9355-6c3d567d0c5a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:05.871258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 262/519] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:05.871258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d981-b97e-447d-9743-3a5b24dd47ac None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:05.900078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:05.996339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e632-fca5-438d-9355-6c3d567d0c5a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:06.010081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d981-b97e-447d-9743-3a5b24dd47ac None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:06.010727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:06.032672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2fbd-e7f2-417f-85f9-6bd72cee6c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:06.033410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2fbd-e7f2-417f-85f9-6bd72cee6c09 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:06.033690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2fbd-e7f2-417f-85f9-6bd72cee6c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:06.033961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2fbd-e7f2-417f-85f9-6bd72cee6c09 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:06.034621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f2fbd-e7f2-417f-85f9-6bd72cee6c09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:06.036090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f2fbd-e7f2-417f-85f9-6bd72cee6c09 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:06.070017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795228f-f98a-4dfd-b552-03c85134158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:06.071620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795228f-f98a-4dfd-b552-03c85134158d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:06.072131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795228f-f98a-4dfd-b552-03c85134158d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:06.072679 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795228f-f98a-4dfd-b552-03c85134158d None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:06.073864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795228f-f98a-4dfd-b552-03c85134158d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:06.074431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795228f-f98a-4dfd-b552-03c85134158d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:06.077118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795228f-f98a-4dfd-b552-03c85134158d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:06.098027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 263/520] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:06.102135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795228f-f98a-4dfd-b552-03c85134158d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:06.130908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 258/521] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:58:05 2022] POST /identity/v3/users => generated 247 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:58:06.136584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2fbd-e7f2-417f-85f9-6bd72cee6c09 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:06.256200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:06.286812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795228f-f98a-4dfd-b552-03c85134158d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:06.344926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2fbd-e7f2-417f-85f9-6bd72cee6c09 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:06.345377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7af7bb-d56b-45b4-af01-6c7777484e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:06.346029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7af7bb-d56b-45b4-af01-6c7777484e22 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:06.346310 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7af7bb-d56b-45b4-af01-6c7777484e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:06.346588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7af7bb-d56b-45b4-af01-6c7777484e22 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:06.347373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7af7bb-d56b-45b4-af01-6c7777484e22 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:06.347692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7af7bb-d56b-45b4-af01-6c7777484e22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:06.349236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7af7bb-d56b-45b4-af01-6c7777484e22 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:06.394714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 264/522] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Sep 1 11:58:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:06.396374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7af7bb-d56b-45b4-af01-6c7777484e22 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:06.408806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1211c7a-2e93-4778-8a66-d66d244f6d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:06.409822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211c7a-2e93-4778-8a66-d66d244f6d07 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:06.410267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211c7a-2e93-4778-8a66-d66d244f6d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:06.410668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211c7a-2e93-4778-8a66-d66d244f6d07 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:06.411835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1211c7a-2e93-4778-8a66-d66d244f6d07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:06.412391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1211c7a-2e93-4778-8a66-d66d244f6d07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:06.415436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1211c7a-2e93-4778-8a66-d66d244f6d07 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:06.446786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 259/523] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:06.447958 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1211c7a-2e93-4778-8a66-d66d244f6d07 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:06.505690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:06.553035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7af7bb-d56b-45b4-af01-6c7777484e22 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:06.618113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe6867-f81b-49f1-958a-313c5a415a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:06.619558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe6867-f81b-49f1-958a-313c5a415a1d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:06.620343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe6867-f81b-49f1-958a-313c5a415a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:06.621065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe6867-f81b-49f1-958a-313c5a415a1d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:06.627000 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1211c7a-2e93-4778-8a66-d66d244f6d07 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:06.634133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe6867-f81b-49f1-958a-313c5a415a1d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:06.636988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe6867-f81b-49f1-958a-313c5a415a1d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b5fe6867-f81b-49f1-958a-313c5a415a1d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:06.660056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:06.662063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 265/524] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:06.663822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe6867-f81b-49f1-958a-313c5a415a1d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:06.674679 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:06.707574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dfdc4-0b17-48b1-9a36-72399696db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:06.708627 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dfdc4-0b17-48b1-9a36-72399696db28 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:06.709087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dfdc4-0b17-48b1-9a36-72399696db28 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:06.710185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dfdc4-0b17-48b1-9a36-72399696db28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:06.725695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dfdc4-0b17-48b1-9a36-72399696db28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:06.729284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dfdc4-0b17-48b1-9a36-72399696db28 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ab6dfdc4-0b17-48b1-9a36-72399696db28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:06.755005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:06.757051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:06.758872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:06.758872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:06.758872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:06.758872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:06.758872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:06.758872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:06.758872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:06.758872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:06.760638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 260/525] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:06.762242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dfdc4-0b17-48b1-9a36-72399696db28 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:06.834967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe6867-f81b-49f1-958a-313c5a415a1d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:06.878741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1824124-f8d4-4fef-ba55-bd99f5220fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:06.879350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824124-f8d4-4fef-ba55-bd99f5220fae None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:06.879695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824124-f8d4-4fef-ba55-bd99f5220fae None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:06.879971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824124-f8d4-4fef-ba55-bd99f5220fae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:06.940744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:06.956098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dfdc4-0b17-48b1-9a36-72399696db28 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:06.986053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1824124-f8d4-4fef-ba55-bd99f5220fae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:06.989695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1824124-f8d4-4fef-ba55-bd99f5220fae None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:06.994298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:07.006833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e29165-990a-4630-9dfc-dfc1fa4b8aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:07.007632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29165-990a-4630-9dfc-dfc1fa4b8aaf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:07.008299 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29165-990a-4630-9dfc-dfc1fa4b8aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:07.009175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29165-990a-4630-9dfc-dfc1fa4b8aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:07.010075 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e29165-990a-4630-9dfc-dfc1fa4b8aaf None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=76b84587baf0432c800a6278d7095cfd) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:07.010565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e29165-990a-4630-9dfc-dfc1fa4b8aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:07.012511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e29165-990a-4630-9dfc-dfc1fa4b8aaf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:07.021710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 261/526] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:06 2022] GET /identity/v3/role_assignments?user.id=76b84587baf0432c800a6278d7095cfd&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:07.023248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e29165-990a-4630-9dfc-dfc1fa4b8aaf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:07.172995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 266/527] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:07.173964 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1824124-f8d4-4fef-ba55-bd99f5220fae None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:07.187107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e29165-990a-4630-9dfc-dfc1fa4b8aaf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:07.228709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea4730-1768-4a8d-950b-692624530e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:07.229493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea4730-1768-4a8d-950b-692624530e1d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:07.229840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea4730-1768-4a8d-950b-692624530e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:07.230179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea4730-1768-4a8d-950b-692624530e1d None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:07.231052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea4730-1768-4a8d-950b-692624530e1d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:07.231427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea4730-1768-4a8d-950b-692624530e1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:07.233075 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea4730-1768-4a8d-950b-692624530e1d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:07.260257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 262/528] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 1 11:58:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:07.260257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea4730-1768-4a8d-950b-692624530e1d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:07.274696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:07.317874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1824124-f8d4-4fef-ba55-bd99f5220fae None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:07.319762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:07.360689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4be02-63e5-4af1-a1dc-c8168b389bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:07.362589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4be02-63e5-4af1-a1dc-c8168b389bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:07.363022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4be02-63e5-4af1-a1dc-c8168b389bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:07.363474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4be02-63e5-4af1-a1dc-c8168b389bd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:07.364371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4be02-63e5-4af1-a1dc-c8168b389bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:07.364823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4be02-63e5-4af1-a1dc-c8168b389bd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:07.368838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4be02-63e5-4af1-a1dc-c8168b389bd3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:07.399463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 267/529] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:07.399463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4be02-63e5-4af1-a1dc-c8168b389bd3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:07.403516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea4730-1768-4a8d-950b-692624530e1d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:07.444002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfe44a-0394-4b31-b400-1293a5183215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:07.445022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe44a-0394-4b31-b400-1293a5183215 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:07.445524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe44a-0394-4b31-b400-1293a5183215 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:07.446049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe44a-0394-4b31-b400-1293a5183215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:07.458257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfe44a-0394-4b31-b400-1293a5183215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:07.460132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfe44a-0394-4b31-b400-1293a5183215 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-13bfe44a-0394-4b31-b400-1293a5183215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:07.478719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:07.479665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:07.480520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:07.480520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:07.480520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:07.482447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 263/530] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:07.483505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfe44a-0394-4b31-b400-1293a5183215 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:07.520403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4be02-63e5-4af1-a1dc-c8168b389bd3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:07.557043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:07.559469 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f87a-c369-46b7-bf71-a4071ac82d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:07.560100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f87a-c369-46b7-bf71-a4071ac82d71 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:07.560414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f87a-c369-46b7-bf71-a4071ac82d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:07.560690 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f87a-c369-46b7-bf71-a4071ac82d71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:07.596504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:07.604834 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfe44a-0394-4b31-b400-1293a5183215 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:07.648160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae35de-8045-4c29-8bec-e87018a2bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:07.648424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635f87a-c369-46b7-bf71-a4071ac82d71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:07.649828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae35de-8045-4c29-8bec-e87018a2bc3d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:07.650303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae35de-8045-4c29-8bec-e87018a2bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:07.650774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635f87a-c369-46b7-bf71-a4071ac82d71 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:07.650878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae35de-8045-4c29-8bec-e87018a2bc3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:07.651807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae35de-8045-4c29-8bec-e87018a2bc3d None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=7790d6ec0e524ee6a31fd06fda9c4ac7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:07.652348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae35de-8045-4c29-8bec-e87018a2bc3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:07.655411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae35de-8045-4c29-8bec-e87018a2bc3d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:07.668788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 264/531] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:07 2022] GET /identity/v3/role_assignments?user.id=7790d6ec0e524ee6a31fd06fda9c4ac7&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:07.670480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae35de-8045-4c29-8bec-e87018a2bc3d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:07.850482 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 268/532] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:07.857184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f87a-c369-46b7-bf71-a4071ac82d71 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:07.934102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:07.989308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae35de-8045-4c29-8bec-e87018a2bc3d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:07.995567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f87a-c369-46b7-bf71-a4071ac82d71 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:08.041173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:08.042278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa165d7-778b-4582-85a8-312e9d12f2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:08.044127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa165d7-778b-4582-85a8-312e9d12f2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:08.044127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa165d7-778b-4582-85a8-312e9d12f2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:08.044127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa165d7-778b-4582-85a8-312e9d12f2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:08.065323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d125e-f4da-4e60-8f4b-e63d514e278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:08.065965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d125e-f4da-4e60-8f4b-e63d514e278c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:08.066247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d125e-f4da-4e60-8f4b-e63d514e278c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:08.066521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d125e-f4da-4e60-8f4b-e63d514e278c None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:08.067230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d125e-f4da-4e60-8f4b-e63d514e278c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:08.067581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d125e-f4da-4e60-8f4b-e63d514e278c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:08.071116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d125e-f4da-4e60-8f4b-e63d514e278c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:08.073671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa165d7-778b-4582-85a8-312e9d12f2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:08.075292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa165d7-778b-4582-85a8-312e9d12f2b5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-ffa165d7-778b-4582-85a8-312e9d12f2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:08.104262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:08.105165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:08.105985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:08.105985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:08.105985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:08.111048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 265/533] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:08.112103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d125e-f4da-4e60-8f4b-e63d514e278c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:08.120323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 269/534] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:08.121861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa165d7-778b-4582-85a8-312e9d12f2b5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:08.241025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d125e-f4da-4e60-8f4b-e63d514e278c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:08.282182 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa165d7-778b-4582-85a8-312e9d12f2b5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:08.288555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7239b00-3fea-46c7-b74d-2b00f8963b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:08.289295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239b00-3fea-46c7-b74d-2b00f8963b92 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:08.290084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239b00-3fea-46c7-b74d-2b00f8963b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:08.290360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239b00-3fea-46c7-b74d-2b00f8963b92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:08.300511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7239b00-3fea-46c7-b74d-2b00f8963b92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:08.301979 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:08.303555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7239b00-3fea-46c7-b74d-2b00f8963b92 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b7239b00-3fea-46c7-b74d-2b00f8963b92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:08.316926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:08.319203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:08.320189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:08.320189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:08.320189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:08.320189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:08.320189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:08.320189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:08.320189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:08.320189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:08.324407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 266/535] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:08.325685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d571-c244-46d8-a964-ee47f008a82a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:08.325685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d571-c244-46d8-a964-ee47f008a82a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:08.325685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d571-c244-46d8-a964-ee47f008a82a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:08.327148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 267/536] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:08.327755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d571-c244-46d8-a964-ee47f008a82a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:08.332990 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d42cf9-b601-47e7-b76d-047013d5f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:08.334460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42cf9-b601-47e7-b76d-047013d5f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:08.334460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42cf9-b601-47e7-b76d-047013d5f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:08.334460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42cf9-b601-47e7-b76d-047013d5f1b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:08.334930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d42cf9-b601-47e7-b76d-047013d5f1b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:08.335242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d42cf9-b601-47e7-b76d-047013d5f1b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:08.337189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d42cf9-b601-47e7-b76d-047013d5f1b3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:08.351528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 270/537] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:08.358919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349991-d3d2-4ae2-bee1-19bf16ac5046 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:08.359591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349991-d3d2-4ae2-bee1-19bf16ac5046 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:08.359877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349991-d3d2-4ae2-bee1-19bf16ac5046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:08.387598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fe349991-d3d2-4ae2-bee1-19bf16ac5046 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:08.389487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fe349991-d3d2-4ae2-bee1-19bf16ac5046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:08.395371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:08.455651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d571-c244-46d8-a964-ee47f008a82a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:08.495681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed14a8-2ee6-431d-97a9-0d12b2201604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:08.496778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed14a8-2ee6-431d-97a9-0d12b2201604 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:08.497260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed14a8-2ee6-431d-97a9-0d12b2201604 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:08.497784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed14a8-2ee6-431d-97a9-0d12b2201604 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:08.498706 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed14a8-2ee6-431d-97a9-0d12b2201604 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:08.499263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed14a8-2ee6-431d-97a9-0d12b2201604 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:08.500988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed14a8-2ee6-431d-97a9-0d12b2201604 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:08.516300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 271/538] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:08.516300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe349991-d3d2-4ae2-bee1-19bf16ac5046 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:08.520013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 268/539] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:08.535129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed14a8-2ee6-431d-97a9-0d12b2201604 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:08.692857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed14a8-2ee6-431d-97a9-0d12b2201604 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:08.705361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:08.730082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe349991-d3d2-4ae2-bee1-19bf16ac5046 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:08.737337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:08.771709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4445-cf17-4404-8b3c-c0c574b673ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:08.772359 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4445-cf17-4404-8b3c-c0c574b673ac None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:08.772642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4445-cf17-4404-8b3c-c0c574b673ac None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:08.772918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4445-cf17-4404-8b3c-c0c574b673ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:08.774257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4445-cf17-4404-8b3c-c0c574b673ac None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=d0eb27228bae4b6d97715c0c46032030) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:08.774576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4445-cf17-4404-8b3c-c0c574b673ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:08.776010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4445-cf17-4404-8b3c-c0c574b673ac None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:08.789604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 269/540] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:08 2022] GET /identity/v3/role_assignments?user.id=d0eb27228bae4b6d97715c0c46032030&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:08.806206 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053d726-deea-437c-b56d-ee080734943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:08.811090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d726-deea-437c-b56d-ee080734943f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:08.811090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d726-deea-437c-b56d-ee080734943f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:08.811090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d726-deea-437c-b56d-ee080734943f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:08.816109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053d726-deea-437c-b56d-ee080734943f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:08.817726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053d726-deea-437c-b56d-ee080734943f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-d053d726-deea-437c-b56d-ee080734943f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:08.844124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:08.845246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:08.846166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:08.846166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:08.846166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:08.846166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:08.846166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:08.846166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:08.846166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:08.846166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:08.846166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 272/541] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:08.852015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4445-cf17-4404-8b3c-c0c574b673ac None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:08.935825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053d726-deea-437c-b56d-ee080734943f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:09.093605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4445-cf17-4404-8b3c-c0c574b673ac None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:09.169795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053d726-deea-437c-b56d-ee080734943f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:09.179047 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c953c42-0ee1-48e7-8be4-1ca06b72c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:09.179766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c953c42-0ee1-48e7-8be4-1ca06b72c36e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:09.180050 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c953c42-0ee1-48e7-8be4-1ca06b72c36e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:09.180350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c953c42-0ee1-48e7-8be4-1ca06b72c36e None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:09.181064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c953c42-0ee1-48e7-8be4-1ca06b72c36e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:09.181374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c953c42-0ee1-48e7-8be4-1ca06b72c36e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:09.182817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c953c42-0ee1-48e7-8be4-1ca06b72c36e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:09.207970 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 270/542] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:09.219702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c953c42-0ee1-48e7-8be4-1ca06b72c36e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:09.257114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d5a1b-caa8-4c62-8c1a-906db7ecff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:09.257799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d5a1b-caa8-4c62-8c1a-906db7ecff8a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:09.258626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d5a1b-caa8-4c62-8c1a-906db7ecff8a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:09.258907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d5a1b-caa8-4c62-8c1a-906db7ecff8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:09.283192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:09.284358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d5a1b-caa8-4c62-8c1a-906db7ecff8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-987d5a1b-caa8-4c62-8c1a-906db7ecff8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:09.295223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:09.301868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:09.303478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:09.305433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 273/543] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:09.310242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d5a1b-caa8-4c62-8c1a-906db7ecff8a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:09.380857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:09.384423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c953c42-0ee1-48e7-8be4-1ca06b72c36e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:09.427676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bf0e7-b4a9-42db-886a-74580f912632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:09.428342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bf0e7-b4a9-42db-886a-74580f912632 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:09.428625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bf0e7-b4a9-42db-886a-74580f912632 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:09.428905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bf0e7-b4a9-42db-886a-74580f912632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:09.429651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bf0e7-b4a9-42db-886a-74580f912632 None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=afb45915b43b471a84fbd363fade7241) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:09.429998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bf0e7-b4a9-42db-886a-74580f912632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:09.431445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bf0e7-b4a9-42db-886a-74580f912632 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:09.439479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 271/544] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:09 2022] GET /identity/v3/role_assignments?user.id=afb45915b43b471a84fbd363fade7241&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:09.514918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d5a1b-caa8-4c62-8c1a-906db7ecff8a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:09.564005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3da1e-f2b4-4f9e-b249-7126cb505f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:09.564684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3da1e-f2b4-4f9e-b249-7126cb505f1e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:09.565077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3da1e-f2b4-4f9e-b249-7126cb505f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:09.565347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3da1e-f2b4-4f9e-b249-7126cb505f1e None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:09.566047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3da1e-f2b4-4f9e-b249-7126cb505f1e None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:09.566355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3da1e-f2b4-4f9e-b249-7126cb505f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:09.567814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3da1e-f2b4-4f9e-b249-7126cb505f1e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:09.578859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 274/545] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:09.584694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bf0e7-b4a9-42db-886a-74580f912632 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:09.724566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:09.734071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bf0e7-b4a9-42db-886a-74580f912632 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:09.780795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96d829-e4f1-46a7-b79a-84fefe19a034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:09.781542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d829-e4f1-46a7-b79a-84fefe19a034 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:09.781894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d829-e4f1-46a7-b79a-84fefe19a034 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:09.782239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d829-e4f1-46a7-b79a-84fefe19a034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:09.794418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96d829-e4f1-46a7-b79a-84fefe19a034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:09.796004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96d829-e4f1-46a7-b79a-84fefe19a034 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-db96d829-e4f1-46a7-b79a-84fefe19a034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:09.812502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:09.814063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:09.815268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:09.815268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:09.815268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:09.815268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 272/546] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:09.820552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3da1e-f2b4-4f9e-b249-7126cb505f1e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:09.967146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:09.993132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3da1e-f2b4-4f9e-b249-7126cb505f1e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:10.037876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a876f-f7f1-4186-a260-e3adfe7ffbbf None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:10.038224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a876f-f7f1-4186-a260-e3adfe7ffbbf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:10.038438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a876f-f7f1-4186-a260-e3adfe7ffbbf None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:10.040911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 273/547] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:10.044043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bba3e-099a-4bdf-8ee9-68642e5cbd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:10.045176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bba3e-099a-4bdf-8ee9-68642e5cbd8e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:10.045735 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bba3e-099a-4bdf-8ee9-68642e5cbd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:10.046356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bba3e-099a-4bdf-8ee9-68642e5cbd8e None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:10.047500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bba3e-099a-4bdf-8ee9-68642e5cbd8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:10.048167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bba3e-099a-4bdf-8ee9-68642e5cbd8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:10.049827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bba3e-099a-4bdf-8ee9-68642e5cbd8e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:10.057971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cf20e-2451-4a3a-b57a-8df74b827fb3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:10.062870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cf20e-2451-4a3a-b57a-8df74b827fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:10.063418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cf20e-2451-4a3a-b57a-8df74b827fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:10.076878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 275/548] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:10.081233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bba3e-099a-4bdf-8ee9-68642e5cbd8e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:10.098897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e05cf20e-2451-4a3a-b57a-8df74b827fb3 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:10.102765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e05cf20e-2451-4a3a-b57a-8df74b827fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:10.213095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 274/549] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:58:10.214441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bad87-29a7-4dec-a248-1e5c03602349 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:10.214737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bad87-29a7-4dec-a248-1e5c03602349 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:10.215017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bad87-29a7-4dec-a248-1e5c03602349 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:10.220628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 275/550] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:10.221932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d205bb-183c-42f2-a5cb-14db893ffd9e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:10.222225 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d205bb-183c-42f2-a5cb-14db893ffd9e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:10.222504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d205bb-183c-42f2-a5cb-14db893ffd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:10.243480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-09d205bb-183c-42f2-a5cb-14db893ffd9e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:10.244783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-09d205bb-183c-42f2-a5cb-14db893ffd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:10.271794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bba3e-099a-4bdf-8ee9-68642e5cbd8e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:10.324110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3012c1-47d7-46ff-a27c-03fa0c1ce56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:10.325053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3012c1-47d7-46ff-a27c-03fa0c1ce56b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:10.325346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3012c1-47d7-46ff-a27c-03fa0c1ce56b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:10.325851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3012c1-47d7-46ff-a27c-03fa0c1ce56b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:10.337825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3012c1-47d7-46ff-a27c-03fa0c1ce56b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:10.339880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3012c1-47d7-46ff-a27c-03fa0c1ce56b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-2d3012c1-47d7-46ff-a27c-03fa0c1ce56b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:10.358250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:10.359801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:10.361096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 276/551] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:10.366881 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3012c1-47d7-46ff-a27c-03fa0c1ce56b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:10.391749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:10.465954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 276/552] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:10.514971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3012c1-47d7-46ff-a27c-03fa0c1ce56b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:10.551786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392d08e-5692-438d-90bb-4e85d36b705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:10.552446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392d08e-5692-438d-90bb-4e85d36b705a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:10.552729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392d08e-5692-438d-90bb-4e85d36b705a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:10.553481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392d08e-5692-438d-90bb-4e85d36b705a None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:10.554291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392d08e-5692-438d-90bb-4e85d36b705a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:10.554602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392d08e-5692-438d-90bb-4e85d36b705a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:10.556592 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392d08e-5692-438d-90bb-4e85d36b705a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:10.577203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 277/553] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 1 11:58:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:10.582495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d205bb-183c-42f2-a5cb-14db893ffd9e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:10.593682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:10.725400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d205bb-183c-42f2-a5cb-14db893ffd9e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:10.753535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392d08e-5692-438d-90bb-4e85d36b705a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:10.793904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96290e-e000-4a37-a930-1c8e8e8ed4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:10.794862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96290e-e000-4a37-a930-1c8e8e8ed4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:10.795499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96290e-e000-4a37-a930-1c8e8e8ed4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:10.795855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96290e-e000-4a37-a930-1c8e8e8ed4e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:10.913421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:10.944757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96290e-e000-4a37-a930-1c8e8e8ed4e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:10.948184 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96290e-e000-4a37-a930-1c8e8e8ed4e7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:10.972650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:10.992013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392d08e-5692-438d-90bb-4e85d36b705a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:11.035251 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49f31-bd4f-4a4c-a30e-c3d856753143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:11.036330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49f31-bd4f-4a4c-a30e-c3d856753143 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:11.036819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49f31-bd4f-4a4c-a30e-c3d856753143 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:11.037294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49f31-bd4f-4a4c-a30e-c3d856753143 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:11.060615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d49f31-bd4f-4a4c-a30e-c3d856753143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-72d49f31-bd4f-4a4c-a30e-c3d856753143 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:11.070287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:11.071321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:11.072130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 278/554] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:11.073336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49f31-bd4f-4a4c-a30e-c3d856753143 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:11.114221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 277/555] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 11:58:11.116019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ee889-2a21-4367-a7ac-420023d89242 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:11.116019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ee889-2a21-4367-a7ac-420023d89242 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:11.116019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ee889-2a21-4367-a7ac-420023d89242 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:11.122439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 278/556] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:11.122439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ee889-2a21-4367-a7ac-420023d89242 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:11.230119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49f31-bd4f-4a4c-a30e-c3d856753143 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:11.264283 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:11.278296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcdacc-ae85-46aa-8cb2-b79d59f9dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:11.279263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ee889-2a21-4367-a7ac-420023d89242 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:11.287296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcdacc-ae85-46aa-8cb2-b79d59f9dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:11.287296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcdacc-ae85-46aa-8cb2-b79d59f9dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:11.287296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcdacc-ae85-46aa-8cb2-b79d59f9dcb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:11.288350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:11.293781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcdacc-ae85-46aa-8cb2-b79d59f9dcb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-dddcdacc-ae85-46aa-8cb2-b79d59f9dcb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:11.299399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:11.300365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:11.301268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:11.302203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 279/557] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:11.303423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcdacc-ae85-46aa-8cb2-b79d59f9dcb4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:11.326850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba260324-ebdf-4b42-87fd-bbd56fd5ae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:11.327507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260324-ebdf-4b42-87fd-bbd56fd5ae4e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:11.327787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260324-ebdf-4b42-87fd-bbd56fd5ae4e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:11.328067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260324-ebdf-4b42-87fd-bbd56fd5ae4e None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:11.328789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba260324-ebdf-4b42-87fd-bbd56fd5ae4e None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:11.329093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba260324-ebdf-4b42-87fd-bbd56fd5ae4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:11.330473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba260324-ebdf-4b42-87fd-bbd56fd5ae4e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:11.339879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 279/558] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:11.341210 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbfcdc-45b8-466c-9ed8-8a887af391f0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:11.341850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbfcdc-45b8-466c-9ed8-8a887af391f0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:11.341850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbfcdc-45b8-466c-9ed8-8a887af391f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:11.363066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4afbfcdc-45b8-466c-9ed8-8a887af391f0 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:11.365286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4afbfcdc-45b8-466c-9ed8-8a887af391f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:11.450757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcdacc-ae85-46aa-8cb2-b79d59f9dcb4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:11.496633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e8bcd-f4c2-4a60-91b5-61c7401ffd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:11.497289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e8bcd-f4c2-4a60-91b5-61c7401ffd82 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:11.497568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e8bcd-f4c2-4a60-91b5-61c7401ffd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:11.497845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e8bcd-f4c2-4a60-91b5-61c7401ffd82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:11.510774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e8bcd-f4c2-4a60-91b5-61c7401ffd82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:11.512295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e8bcd-f4c2-4a60-91b5-61c7401ffd82 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:11.512599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 280/559] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:11.514052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbfcdc-45b8-466c-9ed8-8a887af391f0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f01e8bcd-f4c2-4a60-91b5-61c7401ffd82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:11.537500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:11.539811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:11.541217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:11.541217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:11.541217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:11.543895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 280/560] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:11.544910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e8bcd-f4c2-4a60-91b5-61c7401ffd82 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:11.610674 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:11.667992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:11.673448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbfcdc-45b8-466c-9ed8-8a887af391f0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:11.708534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e8bcd-f4c2-4a60-91b5-61c7401ffd82 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:11.731854 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabebc6-da79-4dc7-98d5-d9c0c19bdec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:11.732976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabebc6-da79-4dc7-98d5-d9c0c19bdec4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:11.733643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabebc6-da79-4dc7-98d5-d9c0c19bdec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:11.733961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabebc6-da79-4dc7-98d5-d9c0c19bdec4 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:11.735216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabebc6-da79-4dc7-98d5-d9c0c19bdec4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:11.735818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabebc6-da79-4dc7-98d5-d9c0c19bdec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:11.738843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabebc6-da79-4dc7-98d5-d9c0c19bdec4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:11.759200 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 281/561] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:11.759200 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabebc6-da79-4dc7-98d5-d9c0c19bdec4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:11.761538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fffff4-20cd-412e-8e3e-a69fe2e0e3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:11.762462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fffff4-20cd-412e-8e3e-a69fe2e0e3de None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:11.762958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fffff4-20cd-412e-8e3e-a69fe2e0e3de None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:11.763427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fffff4-20cd-412e-8e3e-a69fe2e0e3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:11.779150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fffff4-20cd-412e-8e3e-a69fe2e0e3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:11.781392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fffff4-20cd-412e-8e3e-a69fe2e0e3de None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-48fffff4-20cd-412e-8e3e-a69fe2e0e3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:11.802981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:11.803948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:11.804954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:11.804954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:11.804954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:11.806484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 281/562] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:11.807634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fffff4-20cd-412e-8e3e-a69fe2e0e3de None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:11.920199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabebc6-da79-4dc7-98d5-d9c0c19bdec4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:11.922863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:11.941208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fffff4-20cd-412e-8e3e-a69fe2e0e3de None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:11.960061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d0dee-bcf2-40ba-85c8-62d2fe0b0d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:11.960779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d0dee-bcf2-40ba-85c8-62d2fe0b0d4b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:11.961434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d0dee-bcf2-40ba-85c8-62d2fe0b0d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:11.961714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d0dee-bcf2-40ba-85c8-62d2fe0b0d4b None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:11.962368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d0dee-bcf2-40ba-85c8-62d2fe0b0d4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:11.962671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d0dee-bcf2-40ba-85c8-62d2fe0b0d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:11.964035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d0dee-bcf2-40ba-85c8-62d2fe0b0d4b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:11.977890 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 282/563] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:11.985220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d0dee-bcf2-40ba-85c8-62d2fe0b0d4b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:11.987850 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb415d-b670-485d-b6bf-c9f29b971bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:11.989105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb415d-b670-485d-b6bf-c9f29b971bea None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:11.989506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb415d-b670-485d-b6bf-c9f29b971bea None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:11.989890 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb415d-b670-485d-b6bf-c9f29b971bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.003694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb415d-b670-485d-b6bf-c9f29b971bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:12.005274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb415d-b670-485d-b6bf-c9f29b971bea None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:12.012628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-3dcb415d-b670-485d-b6bf-c9f29b971bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:12.021861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:12.026882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:12.027950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:12.027950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:12.027950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:12.027950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 282/564] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:12.027950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec176a-e32b-4be7-9248-ecf60304592d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:12.027950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec176a-e32b-4be7-9248-ecf60304592d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:12.027950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec176a-e32b-4be7-9248-ecf60304592d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.027950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 283/565] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:12.027950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec176a-e32b-4be7-9248-ecf60304592d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:12.136825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d0dee-bcf2-40ba-85c8-62d2fe0b0d4b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:12.155788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec176a-e32b-4be7-9248-ecf60304592d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:12.176150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58707-e917-48b4-94d3-6fbc75817409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:12.177113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58707-e917-48b4-94d3-6fbc75817409 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:12.177618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58707-e917-48b4-94d3-6fbc75817409 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:12.178121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58707-e917-48b4-94d3-6fbc75817409 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.179305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa58707-e917-48b4-94d3-6fbc75817409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:12.180532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa58707-e917-48b4-94d3-6fbc75817409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:12.183129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa58707-e917-48b4-94d3-6fbc75817409 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:12.198292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 283/566] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:12.199156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58707-e917-48b4-94d3-6fbc75817409 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:12.201750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70257c-7a22-49e5-bc3d-7f1c461240ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:12.202828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70257c-7a22-49e5-bc3d-7f1c461240ec None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:12.203478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70257c-7a22-49e5-bc3d-7f1c461240ec None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:12.203975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70257c-7a22-49e5-bc3d-7f1c461240ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.217850 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:12.223487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70257c-7a22-49e5-bc3d-7f1c461240ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-ed70257c-7a22-49e5-bc3d-7f1c461240ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:12.233047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:12.238688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 284/567] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:12.240387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a1483-221b-45dd-9929-680e4b83d4db None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:12.241908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a1483-221b-45dd-9929-680e4b83d4db None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:12.241908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a1483-221b-45dd-9929-680e4b83d4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.262107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ca9a1483-221b-45dd-9929-680e4b83d4db None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:12.263493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ca9a1483-221b-45dd-9929-680e4b83d4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:12.303788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:12.325441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58707-e917-48b4-94d3-6fbc75817409 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:12.376286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 285/568] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:12.376286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a1483-221b-45dd-9929-680e4b83d4db None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:12.387317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362769f-d36b-4932-8a1f-8a63985e0cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:12.388808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362769f-d36b-4932-8a1f-8a63985e0cca None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:12.389166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362769f-d36b-4932-8a1f-8a63985e0cca None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:12.389593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362769f-d36b-4932-8a1f-8a63985e0cca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.401038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362769f-d36b-4932-8a1f-8a63985e0cca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:12.403530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362769f-d36b-4932-8a1f-8a63985e0cca None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-4362769f-d36b-4932-8a1f-8a63985e0cca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:12.416693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:12.417642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:12.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:12.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:12.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:12.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:12.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:12.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:12.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:12.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:12.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 284/569] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:12.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362769f-d36b-4932-8a1f-8a63985e0cca None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:12.497073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a1483-221b-45dd-9929-680e4b83d4db None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:12.547078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:12.558443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3572-a697-4972-9d48-a6d8a62336f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:12.563058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3572-a697-4972-9d48-a6d8a62336f7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:12.563058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3572-a697-4972-9d48-a6d8a62336f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:12.563058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3572-a697-4972-9d48-a6d8a62336f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.563500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362769f-d36b-4932-8a1f-8a63985e0cca None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:12.563661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f3572-a697-4972-9d48-a6d8a62336f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:12.563661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f3572-a697-4972-9d48-a6d8a62336f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:12.564186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f3572-a697-4972-9d48-a6d8a62336f7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:12.585651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 286/570] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:12.587670 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3572-a697-4972-9d48-a6d8a62336f7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:12.613975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8c6f4-0776-4d9b-a229-ef36f9bfc4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:12.615074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8c6f4-0776-4d9b-a229-ef36f9bfc4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:12.615657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8c6f4-0776-4d9b-a229-ef36f9bfc4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:12.616159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8c6f4-0776-4d9b-a229-ef36f9bfc4b4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.630380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8c6f4-0776-4d9b-a229-ef36f9bfc4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:12.633692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8c6f4-0776-4d9b-a229-ef36f9bfc4b4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:12.639006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-64f8c6f4-0776-4d9b-a229-ef36f9bfc4b4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:12.654552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:12.660364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 285/571] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:12.662213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8c6f4-0776-4d9b-a229-ef36f9bfc4b4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:12.728449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3572-a697-4972-9d48-a6d8a62336f7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:12.767249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90688926-f1a5-4394-b8f6-7799953bcad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:12.767755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90688926-f1a5-4394-b8f6-7799953bcad8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:12.768060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90688926-f1a5-4394-b8f6-7799953bcad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:12.768382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90688926-f1a5-4394-b8f6-7799953bcad8 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.769088 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90688926-f1a5-4394-b8f6-7799953bcad8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:12.769398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90688926-f1a5-4394-b8f6-7799953bcad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:12.770884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90688926-f1a5-4394-b8f6-7799953bcad8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:12.780296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 287/572] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:12.780489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8c6f4-0776-4d9b-a229-ef36f9bfc4b4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:12.781144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90688926-f1a5-4394-b8f6-7799953bcad8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:12.841191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:12.870082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d33a6-0454-46de-be8b-92b30d473ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:12.870701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d33a6-0454-46de-be8b-92b30d473ecc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:12.870975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d33a6-0454-46de-be8b-92b30d473ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:12.871247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d33a6-0454-46de-be8b-92b30d473ecc None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.871945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d33a6-0454-46de-be8b-92b30d473ecc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:12.872274 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d33a6-0454-46de-be8b-92b30d473ecc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:12.873736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d33a6-0454-46de-be8b-92b30d473ecc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:12.887745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 286/573] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:12.888667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d33a6-0454-46de-be8b-92b30d473ecc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:12.914742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90688926-f1a5-4394-b8f6-7799953bcad8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:12.954927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815ba04-962f-4ff7-94c3-e7820b735720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:12.955327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:12.955616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815ba04-962f-4ff7-94c3-e7820b735720 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:12.955899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815ba04-962f-4ff7-94c3-e7820b735720 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:12.956181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815ba04-962f-4ff7-94c3-e7820b735720 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:12.964961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815ba04-962f-4ff7-94c3-e7820b735720 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:12.966485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815ba04-962f-4ff7-94c3-e7820b735720 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8815ba04-962f-4ff7-94c3-e7820b735720 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:12.978463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:12.980028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 288/574] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 1 11:58:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:12.981176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815ba04-962f-4ff7-94c3-e7820b735720 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:13.009118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d33a6-0454-46de-be8b-92b30d473ecc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:13.048521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8760d-6363-4b3d-bfaf-4acfd2837781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:13.049223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8760d-6363-4b3d-bfaf-4acfd2837781 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:13.049587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8760d-6363-4b3d-bfaf-4acfd2837781 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:13.049945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8760d-6363-4b3d-bfaf-4acfd2837781 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:13.065891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8760d-6363-4b3d-bfaf-4acfd2837781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b4e8760d-6363-4b3d-bfaf-4acfd2837781 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:13.071784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:13.072773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:13.073625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 287/575] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:13.074749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8760d-6363-4b3d-bfaf-4acfd2837781 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:13.100633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815ba04-962f-4ff7-94c3-e7820b735720 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:13.114668 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:13.136525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457161e-cb48-45c9-9d96-c123422f0bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:13.137214 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457161e-cb48-45c9-9d96-c123422f0bad None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:13.137415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457161e-cb48-45c9-9d96-c123422f0bad None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:13.137678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457161e-cb48-45c9-9d96-c123422f0bad None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:13.138417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457161e-cb48-45c9-9d96-c123422f0bad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:13.138709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457161e-cb48-45c9-9d96-c123422f0bad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:13.140146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457161e-cb48-45c9-9d96-c123422f0bad None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:13.160597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 289/576] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 1 11:58:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:13.161620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457161e-cb48-45c9-9d96-c123422f0bad None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:13.199704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8760d-6363-4b3d-bfaf-4acfd2837781 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:13.221074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:13.237483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee04a-2cdd-4af2-b428-0085dd86e48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:13.238253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee04a-2cdd-4af2-b428-0085dd86e48b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:13.238535 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee04a-2cdd-4af2-b428-0085dd86e48b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:13.238805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee04a-2cdd-4af2-b428-0085dd86e48b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:13.250832 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ee04a-2cdd-4af2-b428-0085dd86e48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:13.252626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ee04a-2cdd-4af2-b428-0085dd86e48b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3c9ee04a-2cdd-4af2-b428-0085dd86e48b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:13.267762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:13.276659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:13.278646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:13.278646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:13.278646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:13.278646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 288/577] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:13.278646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee04a-2cdd-4af2-b428-0085dd86e48b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:13.284918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457161e-cb48-45c9-9d96-c123422f0bad None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:13.322188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f234-6e1f-4385-bf99-999c58996293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:13.322718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f234-6e1f-4385-bf99-999c58996293 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:13.323001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f234-6e1f-4385-bf99-999c58996293 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:13.323278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f234-6e1f-4385-bf99-999c58996293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:13.324014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8f234-6e1f-4385-bf99-999c58996293 None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=8a59a4732ec14a838be9c838dbeb7fd0) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:13.324360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8f234-6e1f-4385-bf99-999c58996293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:13.325823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8f234-6e1f-4385-bf99-999c58996293 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:13.331702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 290/578] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:13 2022] GET /identity/v3/role_assignments?user.id=8a59a4732ec14a838be9c838dbeb7fd0&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:13.332566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f234-6e1f-4385-bf99-999c58996293 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:13.377904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:13.411416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee04a-2cdd-4af2-b428-0085dd86e48b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:13.458775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d198-426c-4a38-9b2c-2f0ee6a46170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:13.459421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d198-426c-4a38-9b2c-2f0ee6a46170 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:13.459703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d198-426c-4a38-9b2c-2f0ee6a46170 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:13.459984 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d198-426c-4a38-9b2c-2f0ee6a46170 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:13.460992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d198-426c-4a38-9b2c-2f0ee6a46170 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:13.462002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d198-426c-4a38-9b2c-2f0ee6a46170 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:13.463012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d198-426c-4a38-9b2c-2f0ee6a46170 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:13.469965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f234-6e1f-4385-bf99-999c58996293 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:13.484564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 289/579] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 1 11:58:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:13.485529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d198-426c-4a38-9b2c-2f0ee6a46170 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:13.519145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fc55c-df1c-4e69-a6cc-fc305f149692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:13.519864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fc55c-df1c-4e69-a6cc-fc305f149692 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:13.520249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fc55c-df1c-4e69-a6cc-fc305f149692 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:13.520528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fc55c-df1c-4e69-a6cc-fc305f149692 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:13.521196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fc55c-df1c-4e69-a6cc-fc305f149692 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:13.521500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fc55c-df1c-4e69-a6cc-fc305f149692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:13.522888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fc55c-df1c-4e69-a6cc-fc305f149692 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:13.531686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:13.537608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 291/580] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:13.538701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fc55c-df1c-4e69-a6cc-fc305f149692 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:13.635338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d198-426c-4a38-9b2c-2f0ee6a46170 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:13.680783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e1596-7779-40b0-aa7e-0d7030f8bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:13.681691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1596-7779-40b0-aa7e-0d7030f8bb52 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:13.682121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1596-7779-40b0-aa7e-0d7030f8bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:13.682540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1596-7779-40b0-aa7e-0d7030f8bb52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:13.685369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:13.692589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fc55c-df1c-4e69-a6cc-fc305f149692 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:13.697177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e1596-7779-40b0-aa7e-0d7030f8bb52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:13.699976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e1596-7779-40b0-aa7e-0d7030f8bb52 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-439e1596-7779-40b0-aa7e-0d7030f8bb52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:13.716757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:13.718058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:13.718925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:13.718925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:13.718925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:13.718925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 290/581] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:13.719238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e1596-7779-40b0-aa7e-0d7030f8bb52 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:13.744147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a73faf-90f6-4b52-b747-cfc3a336f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:13.750546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a73faf-90f6-4b52-b747-cfc3a336f141 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:13.750546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a73faf-90f6-4b52-b747-cfc3a336f141 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:13.750546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a73faf-90f6-4b52-b747-cfc3a336f141 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:13.750546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a73faf-90f6-4b52-b747-cfc3a336f141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:13.750546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a73faf-90f6-4b52-b747-cfc3a336f141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:13.750546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a73faf-90f6-4b52-b747-cfc3a336f141 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:13.775126 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 292/582] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:13.776361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a73faf-90f6-4b52-b747-cfc3a336f141 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:13.844447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:13.866057 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e1596-7779-40b0-aa7e-0d7030f8bb52 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:13.911246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f32453-0d34-4bed-887a-b41aa85b3d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:13.912258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f32453-0d34-4bed-887a-b41aa85b3d90 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:13.912763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f32453-0d34-4bed-887a-b41aa85b3d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:13.913053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f32453-0d34-4bed-887a-b41aa85b3d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:13.927613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f32453-0d34-4bed-887a-b41aa85b3d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:13.931020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f32453-0d34-4bed-887a-b41aa85b3d90 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:13.934700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a73faf-90f6-4b52-b747-cfc3a336f141 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-44f32453-0d34-4bed-887a-b41aa85b3d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:13.958008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:13.959086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:13.959950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:13.959950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:13.959950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:13.959950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 291/583] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:13.961572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f32453-0d34-4bed-887a-b41aa85b3d90 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:13.990516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e139c-8378-41b2-8e8b-dfb546a3c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:13.991249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e139c-8378-41b2-8e8b-dfb546a3c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:13.991599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e139c-8378-41b2-8e8b-dfb546a3c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:13.991881 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e139c-8378-41b2-8e8b-dfb546a3c3c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:14.003390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e139c-8378-41b2-8e8b-dfb546a3c3c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:14.004899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e139c-8378-41b2-8e8b-dfb546a3c3c2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a02e139c-8378-41b2-8e8b-dfb546a3c3c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:14.021308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:14.023309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:14.025648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:14.025648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:14.025648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:14.025648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 293/584] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:14.025648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e139c-8378-41b2-8e8b-dfb546a3c3c2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:14.043775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:14.126845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f32453-0d34-4bed-887a-b41aa85b3d90 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:14.194027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c2586-5d21-4a0d-b621-b48f91248116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:14.194796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2586-5d21-4a0d-b621-b48f91248116 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:14.195249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2586-5d21-4a0d-b621-b48f91248116 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:14.195662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2586-5d21-4a0d-b621-b48f91248116 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:14.196041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e139c-8378-41b2-8e8b-dfb546a3c3c2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:14.196684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c2586-5d21-4a0d-b621-b48f91248116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:14.197135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c2586-5d21-4a0d-b621-b48f91248116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:14.198786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c2586-5d21-4a0d-b621-b48f91248116 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:14.200964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:14.223079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 292/585] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:14.223079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c2586-5d21-4a0d-b621-b48f91248116 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:14.267708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009d9ce-f891-4c29-9939-f532110364d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:14.268460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009d9ce-f891-4c29-9939-f532110364d7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:14.268743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009d9ce-f891-4c29-9939-f532110364d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:14.269017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009d9ce-f891-4c29-9939-f532110364d7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:14.278799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009d9ce-f891-4c29-9939-f532110364d7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:14.280334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009d9ce-f891-4c29-9939-f532110364d7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f009d9ce-f891-4c29-9939-f532110364d7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:14.294066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:14.296154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:14.298596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:14.298596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:14.298596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:14.298596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:14.298596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:14.298596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:14.298596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:14.298596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:14.298596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 11:58:14.298596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:14.300195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 294/586] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:14.301161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009d9ce-f891-4c29-9939-f532110364d7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:14.387904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c2586-5d21-4a0d-b621-b48f91248116 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:14.392331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:14.432687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009d9ce-f891-4c29-9939-f532110364d7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:14.438522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95937697-ccec-4fe4-b70b-c25e1db0c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:14.439144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937697-ccec-4fe4-b70b-c25e1db0c919 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:14.439425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937697-ccec-4fe4-b70b-c25e1db0c919 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:14.439702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937697-ccec-4fe4-b70b-c25e1db0c919 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:14.440401 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95937697-ccec-4fe4-b70b-c25e1db0c919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:14.440708 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95937697-ccec-4fe4-b70b-c25e1db0c919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:14.442242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95937697-ccec-4fe4-b70b-c25e1db0c919 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:14.461450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 293/587] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:14.463015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95937697-ccec-4fe4-b70b-c25e1db0c919 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:14.477236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a62ce-f7c9-4eb9-95ef-a780662caa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:14.477862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a62ce-f7c9-4eb9-95ef-a780662caa4d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:14.478154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a62ce-f7c9-4eb9-95ef-a780662caa4d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:14.478431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a62ce-f7c9-4eb9-95ef-a780662caa4d None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:14.479093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a62ce-f7c9-4eb9-95ef-a780662caa4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:14.479403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a62ce-f7c9-4eb9-95ef-a780662caa4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:14.480839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a62ce-f7c9-4eb9-95ef-a780662caa4d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:14.505313 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 295/588] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:14.505313 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a62ce-f7c9-4eb9-95ef-a780662caa4d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:14.534963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:14.610094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95937697-ccec-4fe4-b70b-c25e1db0c919 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:14.651551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a62ce-f7c9-4eb9-95ef-a780662caa4d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:14.671501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4303849-5c26-48dd-bd91-95c865b9e57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:14.672847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303849-5c26-48dd-bd91-95c865b9e57a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:14.673333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303849-5c26-48dd-bd91-95c865b9e57a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:14.673809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303849-5c26-48dd-bd91-95c865b9e57a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:14.684617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:14.687360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4303849-5c26-48dd-bd91-95c865b9e57a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:14.690271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4303849-5c26-48dd-bd91-95c865b9e57a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:14.696528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79bb0d-9dc9-4bef-ad26-5e6840c3891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:14.697313 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79bb0d-9dc9-4bef-ad26-5e6840c3891d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:14.700255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79bb0d-9dc9-4bef-ad26-5e6840c3891d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:14.700255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79bb0d-9dc9-4bef-ad26-5e6840c3891d None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:14.700255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79bb0d-9dc9-4bef-ad26-5e6840c3891d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:14.700255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79bb0d-9dc9-4bef-ad26-5e6840c3891d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:14.701299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79bb0d-9dc9-4bef-ad26-5e6840c3891d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d4303849-5c26-48dd-bd91-95c865b9e57a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:14.713268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:14.715081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:14.718481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:14.718481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:14.718481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:14.718481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:14.718481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:14.718481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:14.718481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:14.718481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:14.718481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 294/589] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:14.718481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4303849-5c26-48dd-bd91-95c865b9e57a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:14.731193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 296/590] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Sep 1 11:58:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:14.737677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79bb0d-9dc9-4bef-ad26-5e6840c3891d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:14.877375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79bb0d-9dc9-4bef-ad26-5e6840c3891d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:14.907632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4303849-5c26-48dd-bd91-95c865b9e57a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:14.932824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adac38-2f16-4a1f-8ade-74229e805428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:14.933889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adac38-2f16-4a1f-8ade-74229e805428 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:14.934266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adac38-2f16-4a1f-8ade-74229e805428 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:14.934684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adac38-2f16-4a1f-8ade-74229e805428 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:14.938583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:14.946680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adac38-2f16-4a1f-8ade-74229e805428 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:14.948402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adac38-2f16-4a1f-8ade-74229e805428 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f5adac38-2f16-4a1f-8ade-74229e805428 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:14.968244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:14.970278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 297/591] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:14.972391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adac38-2f16-4a1f-8ade-74229e805428 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:14.980427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edff18-62b0-48f7-a8f7-ab83805f4b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:14.982292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edff18-62b0-48f7-a8f7-ab83805f4b64 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:14.982887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edff18-62b0-48f7-a8f7-ab83805f4b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:14.983463 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edff18-62b0-48f7-a8f7-ab83805f4b64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:14.996024 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edff18-62b0-48f7-a8f7-ab83805f4b64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:14.998991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edff18-62b0-48f7-a8f7-ab83805f4b64 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-78edff18-62b0-48f7-a8f7-ab83805f4b64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:15.014960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:15.016981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:15.019045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:15.019045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:15.019045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:15.019045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:15.019045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:15.019045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:15.019045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:15.019045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:15.025909 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 295/592] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:15.027071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edff18-62b0-48f7-a8f7-ab83805f4b64 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:15.065729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:15.164981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edff18-62b0-48f7-a8f7-ab83805f4b64 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:15.169163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adac38-2f16-4a1f-8ade-74229e805428 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:15.208743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb8c4-2e5d-47c7-9982-2e805ebf7d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:15.210014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb8c4-2e5d-47c7-9982-2e805ebf7d66 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:15.210294 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb8c4-2e5d-47c7-9982-2e805ebf7d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:15.210650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb8c4-2e5d-47c7-9982-2e805ebf7d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:15.223494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb8c4-2e5d-47c7-9982-2e805ebf7d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:15.224943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb8c4-2e5d-47c7-9982-2e805ebf7d66 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:15.236051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6647-67ec-45a3-8338-3036311ae8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:15.237260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6647-67ec-45a3-8338-3036311ae8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:15.237738 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6647-67ec-45a3-8338-3036311ae8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:15.238211 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6647-67ec-45a3-8338-3036311ae8a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:15.239470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd6647-67ec-45a3-8338-3036311ae8a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:15.239966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd6647-67ec-45a3-8338-3036311ae8a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-103cb8c4-2e5d-47c7-9982-2e805ebf7d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:15.242846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:15.252310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:15.254269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:15.254269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:15.254269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:15.254641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd6647-67ec-45a3-8338-3036311ae8a8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:15.254786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 296/593] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:15.254786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb8c4-2e5d-47c7-9982-2e805ebf7d66 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:15.283728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 298/594] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:15.283728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6647-67ec-45a3-8338-3036311ae8a8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:15.311997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:15.424626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb8c4-2e5d-47c7-9982-2e805ebf7d66 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:15.448418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6647-67ec-45a3-8338-3036311ae8a8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:15.464749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:15.494845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fe7f1-52b1-402f-964d-26bc8fa17ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:15.496276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe7f1-52b1-402f-964d-26bc8fa17ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:15.496995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe7f1-52b1-402f-964d-26bc8fa17ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:15.497476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe7f1-52b1-402f-964d-26bc8fa17ed3 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:15.498884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fe7f1-52b1-402f-964d-26bc8fa17ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:15.499376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fe7f1-52b1-402f-964d-26bc8fa17ed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:15.501969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fe7f1-52b1-402f-964d-26bc8fa17ed3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:15.503640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6da21-e7b7-445e-a116-1f9190c8c634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:15.504436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6da21-e7b7-445e-a116-1f9190c8c634 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:15.505119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6da21-e7b7-445e-a116-1f9190c8c634 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:15.505360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6da21-e7b7-445e-a116-1f9190c8c634 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:15.506307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6da21-e7b7-445e-a116-1f9190c8c634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:15.506745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6da21-e7b7-445e-a116-1f9190c8c634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:15.509146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6da21-e7b7-445e-a116-1f9190c8c634 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:15.523522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 299/595] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:15.524750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6da21-e7b7-445e-a116-1f9190c8c634 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:15.541557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 297/596] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 1 11:58:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:15.544061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fe7f1-52b1-402f-964d-26bc8fa17ed3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:15.668858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:15.674124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6da21-e7b7-445e-a116-1f9190c8c634 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:15.690697 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fe7f1-52b1-402f-964d-26bc8fa17ed3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:15.731620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbf4d0-697f-4c1c-9d26-ddde49638a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:15.732637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbf4d0-697f-4c1c-9d26-ddde49638a07 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:15.733235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbf4d0-697f-4c1c-9d26-ddde49638a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:15.733657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbf4d0-697f-4c1c-9d26-ddde49638a07 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:15.734644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbf4d0-697f-4c1c-9d26-ddde49638a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:15.735141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbf4d0-697f-4c1c-9d26-ddde49638a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:15.737653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbf4d0-697f-4c1c-9d26-ddde49638a07 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:15.740740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57459f3-024e-4037-b758-58fecd6d788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:15.741758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57459f3-024e-4037-b758-58fecd6d788f None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:15.742199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57459f3-024e-4037-b758-58fecd6d788f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:15.742782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57459f3-024e-4037-b758-58fecd6d788f None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/76b84587baf0432c800a6278d7095cfd/roles/22cfc07169ee49d685af3262b384f78b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:15.763433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 300/597] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:15.763433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbf4d0-697f-4c1c-9d26-ddde49638a07 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:15.768068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57459f3-024e-4037-b758-58fecd6d788f None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=76b84587baf0432c800a6278d7095cfd, role_id=22cfc07169ee49d685af3262b384f78b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:15.770553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57459f3-024e-4037-b758-58fecd6d788f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:15.795478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:15.826263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 298/598] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:58:15 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/76b84587baf0432c800a6278d7095cfd/roles/22cfc07169ee49d685af3262b384f78b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:58:15.827423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57459f3-024e-4037-b758-58fecd6d788f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:15.905709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbf4d0-697f-4c1c-9d26-ddde49638a07 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:15.962250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe2b5a-0a6b-4de5-93b0-b7923d3c92bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:15.963504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe2b5a-0a6b-4de5-93b0-b7923d3c92bc None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:15.964074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe2b5a-0a6b-4de5-93b0-b7923d3c92bc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:15.964686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe2b5a-0a6b-4de5-93b0-b7923d3c92bc None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/7790d6ec0e524ee6a31fd06fda9c4ac7/roles/22cfc07169ee49d685af3262b384f78b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:15.991218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe2b5a-0a6b-4de5-93b0-b7923d3c92bc None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=7790d6ec0e524ee6a31fd06fda9c4ac7, role_id=22cfc07169ee49d685af3262b384f78b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:15.994164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe2b5a-0a6b-4de5-93b0-b7923d3c92bc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:16.014785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57459f3-024e-4037-b758-58fecd6d788f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:16.068873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 301/599] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:58:15 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/7790d6ec0e524ee6a31fd06fda9c4ac7/roles/22cfc07169ee49d685af3262b384f78b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:58:16.070434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc42af-cd2e-4b0a-b51b-7275c499aa34 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:16.070717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc42af-cd2e-4b0a-b51b-7275c499aa34 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:16.070995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc42af-cd2e-4b0a-b51b-7275c499aa34 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:16.076634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 302/600] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:16.077746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc42af-cd2e-4b0a-b51b-7275c499aa34 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:16.088762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446fcca-01f4-48b6-8435-b3bddbbfb3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:16.090405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446fcca-01f4-48b6-8435-b3bddbbfb3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:16.091328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446fcca-01f4-48b6-8435-b3bddbbfb3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:16.092090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446fcca-01f4-48b6-8435-b3bddbbfb3d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:16.096648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:16.116978 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446fcca-01f4-48b6-8435-b3bddbbfb3d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:16.120383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446fcca-01f4-48b6-8435-b3bddbbfb3d4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6446fcca-01f4-48b6-8435-b3bddbbfb3d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:16.162487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:16.164270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:16.165422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:16.165422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:16.165422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:16.167198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 299/601] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:16.168521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b8062-3b2d-4c6d-8c64-e83b4f0d93aa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:16.169014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b8062-3b2d-4c6d-8c64-e83b4f0d93aa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:16.169477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b8062-3b2d-4c6d-8c64-e83b4f0d93aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:16.204970 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e87b8062-3b2d-4c6d-8c64-e83b4f0d93aa None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:16.207216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e87b8062-3b2d-4c6d-8c64-e83b4f0d93aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:16.237019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:16.290804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc42af-cd2e-4b0a-b51b-7275c499aa34 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:16.336483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 300/602] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:16.338120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b8062-3b2d-4c6d-8c64-e83b4f0d93aa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:16.371304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac88432-bf93-452a-8b25-cef2c8aa3ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:16.374172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88432-bf93-452a-8b25-cef2c8aa3ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:16.375374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88432-bf93-452a-8b25-cef2c8aa3ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:16.377356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88432-bf93-452a-8b25-cef2c8aa3ee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:16.403746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac88432-bf93-452a-8b25-cef2c8aa3ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:16.409716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac88432-bf93-452a-8b25-cef2c8aa3ee0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8ac88432-bf93-452a-8b25-cef2c8aa3ee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:16.440054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:16.441118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:16.442122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:16.442122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:16.442122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:16.442122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:16.442122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:16.442122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:16.442122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:16.442122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:16.447618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 303/603] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:16.482746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac88432-bf93-452a-8b25-cef2c8aa3ee0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:16.525273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b8062-3b2d-4c6d-8c64-e83b4f0d93aa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:16.545031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:16.625334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c64e1-41ac-4f4d-af12-81a82f863fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:16.626322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c64e1-41ac-4f4d-af12-81a82f863fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:16.626786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c64e1-41ac-4f4d-af12-81a82f863fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:16.627230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c64e1-41ac-4f4d-af12-81a82f863fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:16.628348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c64e1-41ac-4f4d-af12-81a82f863fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:16.628885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c64e1-41ac-4f4d-af12-81a82f863fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:16.631399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c64e1-41ac-4f4d-af12-81a82f863fb6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:16.681063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 301/604] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:16.688462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c64e1-41ac-4f4d-af12-81a82f863fb6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:16.722966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac88432-bf93-452a-8b25-cef2c8aa3ee0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:16.786061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be99dcd-b39d-4e6b-8e4e-158579ef791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:16.787556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99dcd-b39d-4e6b-8e4e-158579ef791e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:16.788367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99dcd-b39d-4e6b-8e4e-158579ef791e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:16.790048 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99dcd-b39d-4e6b-8e4e-158579ef791e None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:16.791860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be99dcd-b39d-4e6b-8e4e-158579ef791e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:16.792727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be99dcd-b39d-4e6b-8e4e-158579ef791e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:16.796013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be99dcd-b39d-4e6b-8e4e-158579ef791e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:16.801576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:16.831596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 304/605] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:16.833829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be99dcd-b39d-4e6b-8e4e-158579ef791e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:16.899326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c64e1-41ac-4f4d-af12-81a82f863fb6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:16.968551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f393e-910f-4f8b-83d8-5f3aceabe469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:16.969782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f393e-910f-4f8b-83d8-5f3aceabe469 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:16.970063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f393e-910f-4f8b-83d8-5f3aceabe469 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:16.970615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f393e-910f-4f8b-83d8-5f3aceabe469 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:16.984434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f393e-910f-4f8b-83d8-5f3aceabe469 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:16.987488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f393e-910f-4f8b-83d8-5f3aceabe469 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0f3f393e-910f-4f8b-83d8-5f3aceabe469 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:17.012896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:17.014992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:17.017290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:17.017290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:17.017290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:17.017290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:17.017290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:17.017290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:17.017290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:17.017290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:17.017290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 302/606] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:17.017290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f393e-910f-4f8b-83d8-5f3aceabe469 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:17.045331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be99dcd-b39d-4e6b-8e4e-158579ef791e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:17.086660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:17.112295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168d60-2ef9-4928-aa9b-4bf1f0739e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:17.113394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168d60-2ef9-4928-aa9b-4bf1f0739e5f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:17.113896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168d60-2ef9-4928-aa9b-4bf1f0739e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:17.114379 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168d60-2ef9-4928-aa9b-4bf1f0739e5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:17.135189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e168d60-2ef9-4928-aa9b-4bf1f0739e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-4e168d60-2ef9-4928-aa9b-4bf1f0739e5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:17.145109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:17.147203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:17.149213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:17.155002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 305/607] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:17.156636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168d60-2ef9-4928-aa9b-4bf1f0739e5f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:17.221494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f393e-910f-4f8b-83d8-5f3aceabe469 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:17.264371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:17.290112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e977c-e0fe-4b38-9dd2-c2d3d42a24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:17.291577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e977c-e0fe-4b38-9dd2-c2d3d42a24fa None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:17.292338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e977c-e0fe-4b38-9dd2-c2d3d42a24fa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:17.293020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e977c-e0fe-4b38-9dd2-c2d3d42a24fa None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/d0eb27228bae4b6d97715c0c46032030/roles/22cfc07169ee49d685af3262b384f78b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:17.324687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e977c-e0fe-4b38-9dd2-c2d3d42a24fa None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=d0eb27228bae4b6d97715c0c46032030, role_id=22cfc07169ee49d685af3262b384f78b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:17.327857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e977c-e0fe-4b38-9dd2-c2d3d42a24fa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:17.351439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168d60-2ef9-4928-aa9b-4bf1f0739e5f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:17.419815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628214e-7feb-40f1-b7c7-9914959d04de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:17.420930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628214e-7feb-40f1-b7c7-9914959d04de None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:17.421679 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628214e-7feb-40f1-b7c7-9914959d04de None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:17.422174 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628214e-7feb-40f1-b7c7-9914959d04de None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:17.423430 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628214e-7feb-40f1-b7c7-9914959d04de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:17.423892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628214e-7feb-40f1-b7c7-9914959d04de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:17.426224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628214e-7feb-40f1-b7c7-9914959d04de None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:17.456260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 306/608] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:17.456260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628214e-7feb-40f1-b7c7-9914959d04de None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:17.474594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 303/609] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:58:17 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/d0eb27228bae4b6d97715c0c46032030/roles/22cfc07169ee49d685af3262b384f78b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:58:17.481628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e977c-e0fe-4b38-9dd2-c2d3d42a24fa None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:17.691029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628214e-7feb-40f1-b7c7-9914959d04de None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:17.725281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:17.740706 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:17.774191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e977c-e0fe-4b38-9dd2-c2d3d42a24fa None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:17.777339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a17326-9c8c-4dd5-b133-b8ace707c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:17.778835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17326-9c8c-4dd5-b133-b8ace707c35a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:17.779617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17326-9c8c-4dd5-b133-b8ace707c35a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:17.780360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17326-9c8c-4dd5-b133-b8ace707c35a None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:17.781835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a17326-9c8c-4dd5-b133-b8ace707c35a None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:17.787394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a17326-9c8c-4dd5-b133-b8ace707c35a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:17.787394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a17326-9c8c-4dd5-b133-b8ace707c35a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:17.822163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 307/610] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:17.837134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a17326-9c8c-4dd5-b133-b8ace707c35a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:17.839090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdd180-88de-40a2-a56c-108061832054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:17.840237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdd180-88de-40a2-a56c-108061832054 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:17.840536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdd180-88de-40a2-a56c-108061832054 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:17.840910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdd180-88de-40a2-a56c-108061832054 None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/afb45915b43b471a84fbd363fade7241/roles/22cfc07169ee49d685af3262b384f78b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:17.860242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdd180-88de-40a2-a56c-108061832054 None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=afb45915b43b471a84fbd363fade7241, role_id=22cfc07169ee49d685af3262b384f78b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:17.861832 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdd180-88de-40a2-a56c-108061832054 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:17.948078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 304/611] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:58:17 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/afb45915b43b471a84fbd363fade7241/roles/22cfc07169ee49d685af3262b384f78b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:58:18.018930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a17326-9c8c-4dd5-b133-b8ace707c35a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:18.080414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e62481-d4a4-4e62-9f03-a0281d9e587e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:18.081154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e62481-d4a4-4e62-9f03-a0281d9e587e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:18.081443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e62481-d4a4-4e62-9f03-a0281d9e587e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:18.081802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e62481-d4a4-4e62-9f03-a0281d9e587e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:18.101522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e62481-d4a4-4e62-9f03-a0281d9e587e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:18.103737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e62481-d4a4-4e62-9f03-a0281d9e587e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e1e62481-d4a4-4e62-9f03-a0281d9e587e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:18.131905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:18.133541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:18.134399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:18.134399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:18.134399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:18.139232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 308/612] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:18.142756 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdd180-88de-40a2-a56c-108061832054 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:18.344769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdd180-88de-40a2-a56c-108061832054 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:18.425487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaf5ae-6dbb-4cf1-a788-972812b6eedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:18.426144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaf5ae-6dbb-4cf1-a788-972812b6eedd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:18.426771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaf5ae-6dbb-4cf1-a788-972812b6eedd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:18.428600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaf5ae-6dbb-4cf1-a788-972812b6eedd None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:18.429802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b7c2-c897-4123-b8b5-ed6245f1009d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:18.429940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaf5ae-6dbb-4cf1-a788-972812b6eedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:18.430173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaf5ae-6dbb-4cf1-a788-972812b6eedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:18.430284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b7c2-c897-4123-b8b5-ed6245f1009d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:18.430742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b7c2-c897-4123-b8b5-ed6245f1009d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:18.431578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaf5ae-6dbb-4cf1-a788-972812b6eedd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:18.434022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 309/613] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:18.442301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c42e7d-9560-44cb-a87e-5648617e88ea None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:18.442627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c42e7d-9560-44cb-a87e-5648617e88ea None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:18.442863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c42e7d-9560-44cb-a87e-5648617e88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:18.445670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 305/614] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:18.446036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:18.454164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaf5ae-6dbb-4cf1-a788-972812b6eedd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:18.498437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-01c42e7d-9560-44cb-a87e-5648617e88ea None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:18.500385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-01c42e7d-9560-44cb-a87e-5648617e88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:18.534473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:18.644271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 310/615] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:18.644271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098dcef-eb97-4863-a2d2-a788f1f7ef33 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:18.651044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098dcef-eb97-4863-a2d2-a788f1f7ef33 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:18.651693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098dcef-eb97-4863-a2d2-a788f1f7ef33 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:18.654805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 311/616] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:18 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:18.671217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0798b7-6d22-4aef-8739-6b6f3874c893 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:18.673002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0798b7-6d22-4aef-8739-6b6f3874c893 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:18.673534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0798b7-6d22-4aef-8739-6b6f3874c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:18.726757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1a0798b7-6d22-4aef-8739-6b6f3874c893 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:18.727985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1a0798b7-6d22-4aef-8739-6b6f3874c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:18.747215 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaf5ae-6dbb-4cf1-a788-972812b6eedd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:18.818627 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442a0dd-291b-47b1-a175-4d5f4210256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:18.819723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442a0dd-291b-47b1-a175-4d5f4210256e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:18.820779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442a0dd-291b-47b1-a175-4d5f4210256e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:18.821275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442a0dd-291b-47b1-a175-4d5f4210256e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:18.851225 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442a0dd-291b-47b1-a175-4d5f4210256e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:18.853870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442a0dd-291b-47b1-a175-4d5f4210256e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3442a0dd-291b-47b1-a175-4d5f4210256e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:18.879839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:18.881750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:18.885187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 306/617] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:18.891783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442a0dd-291b-47b1-a175-4d5f4210256e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:18.939005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 312/618] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:18.997499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:19.073027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442a0dd-291b-47b1-a175-4d5f4210256e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:19.133877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4381c7-9da8-4674-9796-8fd4a19ee44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:19.134920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4381c7-9da8-4674-9796-8fd4a19ee44a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:19.135207 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4381c7-9da8-4674-9796-8fd4a19ee44a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:19.135505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4381c7-9da8-4674-9796-8fd4a19ee44a None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:19.136884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4381c7-9da8-4674-9796-8fd4a19ee44a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:19.137195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4381c7-9da8-4674-9796-8fd4a19ee44a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:19.139327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4381c7-9da8-4674-9796-8fd4a19ee44a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:19.168495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 307/619] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 1 11:58:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:19.170014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0798b7-6d22-4aef-8739-6b6f3874c893 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:19.292070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4381c7-9da8-4674-9796-8fd4a19ee44a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:19.337189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:19.354409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0798b7-6d22-4aef-8739-6b6f3874c893 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:19.418312 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca316-d3ab-4994-b48a-3c23b76a703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:19.419286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca316-d3ab-4994-b48a-3c23b76a703b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:19.419795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca316-d3ab-4994-b48a-3c23b76a703b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:19.420481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca316-d3ab-4994-b48a-3c23b76a703b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:19.440637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca316-d3ab-4994-b48a-3c23b76a703b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:19.443764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca316-d3ab-4994-b48a-3c23b76a703b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:19.462609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4381c7-9da8-4674-9796-8fd4a19ee44a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-71aca316-d3ab-4994-b48a-3c23b76a703b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:19.475045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:19.476700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:19.477596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:19.477596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:19.477596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:19.478255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 313/620] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:19.478794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:19.480877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca316-d3ab-4994-b48a-3c23b76a703b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:19.507810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77879df4-87a1-4e54-a18e-3a1fe314e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:19.508520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77879df4-87a1-4e54-a18e-3a1fe314e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:19.508798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77879df4-87a1-4e54-a18e-3a1fe314e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:19.509193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77879df4-87a1-4e54-a18e-3a1fe314e1a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:19.523010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77879df4-87a1-4e54-a18e-3a1fe314e1a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-77879df4-87a1-4e54-a18e-3a1fe314e1a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:19.528560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:19.530333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 308/621] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:19.532243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77879df4-87a1-4e54-a18e-3a1fe314e1a2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:19.686833 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca316-d3ab-4994-b48a-3c23b76a703b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:19.696455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77879df4-87a1-4e54-a18e-3a1fe314e1a2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:19.759901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64698c0-416f-43c1-934b-31beb29cf9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:19.761884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c3ce7-c635-488d-866f-356b4b984224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:19.762896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3ce7-c635-488d-866f-356b4b984224 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:19.763194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64698c0-416f-43c1-934b-31beb29cf9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:19.763360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3ce7-c635-488d-866f-356b4b984224 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:19.763493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3ce7-c635-488d-866f-356b4b984224 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:19.764192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c3ce7-c635-488d-866f-356b4b984224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:19.764782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c3ce7-c635-488d-866f-356b4b984224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:19.767358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c3ce7-c635-488d-866f-356b4b984224 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:19.768421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64698c0-416f-43c1-934b-31beb29cf9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:19.769229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64698c0-416f-43c1-934b-31beb29cf9d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:19.792057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64698c0-416f-43c1-934b-31beb29cf9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:19.798812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 309/622] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:19.800332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c3ce7-c635-488d-866f-356b4b984224 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f64698c0-416f-43c1-934b-31beb29cf9d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:19.804327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:19.806276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:19.807969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:19.814011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 314/623] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:19.815914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64698c0-416f-43c1-934b-31beb29cf9d4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:19.875378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:19.891182 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:20.007977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c3ce7-c635-488d-866f-356b4b984224 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:20.018616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64698c0-416f-43c1-934b-31beb29cf9d4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:20.070880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed843f9c-4b1a-44e7-9311-0b1e41a4a8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:20.071917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed843f9c-4b1a-44e7-9311-0b1e41a4a8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.072452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed843f9c-4b1a-44e7-9311-0b1e41a4a8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.072952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed843f9c-4b1a-44e7-9311-0b1e41a4a8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.074561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed843f9c-4b1a-44e7-9311-0b1e41a4a8e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:20.074734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed843f9c-4b1a-44e7-9311-0b1e41a4a8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:20.077403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed843f9c-4b1a-44e7-9311-0b1e41a4a8e8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:20.089059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6125de-18b8-4688-a5be-edbb64a0e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:20.090474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6125de-18b8-4688-a5be-edbb64a0e67d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.091222 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6125de-18b8-4688-a5be-edbb64a0e67d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.091954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6125de-18b8-4688-a5be-edbb64a0e67d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.093275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 310/624] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:20.094518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed843f9c-4b1a-44e7-9311-0b1e41a4a8e8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:20.108910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6125de-18b8-4688-a5be-edbb64a0e67d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:20.112025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6125de-18b8-4688-a5be-edbb64a0e67d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-3c6125de-18b8-4688-a5be-edbb64a0e67d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:20.131279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:20.132532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:20.133453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:20.133453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:20.133453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:20.133453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:20.133453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:20.133453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:20.133453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:20.133453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:20.133453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 315/625] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:20.135401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5582-6d7b-4990-ace4-ac5cd076ee57 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.135690 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5582-6d7b-4990-ace4-ac5cd076ee57 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.136049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae5582-6d7b-4990-ace4-ac5cd076ee57 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.138518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 316/626] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:20.143296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae5582-6d7b-4990-ace4-ac5cd076ee57 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:20.219590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:20.221003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:20.228094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed843f9c-4b1a-44e7-9311-0b1e41a4a8e8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:20.273587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a90bf7-c59d-4e18-a71b-fa7bfd1aa472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:20.274574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a90bf7-c59d-4e18-a71b-fa7bfd1aa472 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.275080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a90bf7-c59d-4e18-a71b-fa7bfd1aa472 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.275539 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a90bf7-c59d-4e18-a71b-fa7bfd1aa472 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.276641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a90bf7-c59d-4e18-a71b-fa7bfd1aa472 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:20.277170 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a90bf7-c59d-4e18-a71b-fa7bfd1aa472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:20.279994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a90bf7-c59d-4e18-a71b-fa7bfd1aa472 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:20.280646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae5582-6d7b-4990-ace4-ac5cd076ee57 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:20.306994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 311/627] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:20.308146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a90bf7-c59d-4e18-a71b-fa7bfd1aa472 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:20.327025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf51da2-1654-4dbf-8740-bff5d0154802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:20.327871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf51da2-1654-4dbf-8740-bff5d0154802 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.328198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf51da2-1654-4dbf-8740-bff5d0154802 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.328638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf51da2-1654-4dbf-8740-bff5d0154802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.341732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf51da2-1654-4dbf-8740-bff5d0154802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:20.343259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf51da2-1654-4dbf-8740-bff5d0154802 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-aaf51da2-1654-4dbf-8740-bff5d0154802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:20.360095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:20.361388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:20.362380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:20.362380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:20.362380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:20.362380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 317/628] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:20.363922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50766c-a7d2-48da-b06f-e32ee47473b3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.363922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50766c-a7d2-48da-b06f-e32ee47473b3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.363922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50766c-a7d2-48da-b06f-e32ee47473b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.386827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0e50766c-a7d2-48da-b06f-e32ee47473b3 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:20.388042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0e50766c-a7d2-48da-b06f-e32ee47473b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:20.443169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a90bf7-c59d-4e18-a71b-fa7bfd1aa472 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:20.480990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925244c-3b19-40bd-a103-cceac6eb5ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:20.481738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925244c-3b19-40bd-a103-cceac6eb5ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.482154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925244c-3b19-40bd-a103-cceac6eb5ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.482453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925244c-3b19-40bd-a103-cceac6eb5ab1 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.483195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925244c-3b19-40bd-a103-cceac6eb5ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:20.483441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 318/629] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:20.483549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925244c-3b19-40bd-a103-cceac6eb5ab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:20.484342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50766c-a7d2-48da-b06f-e32ee47473b3 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:20.485465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925244c-3b19-40bd-a103-cceac6eb5ab1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:20.500679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 312/630] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:20.501551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925244c-3b19-40bd-a103-cceac6eb5ab1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:20.530770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:20.566970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:20.652922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925244c-3b19-40bd-a103-cceac6eb5ab1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:20.653973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50766c-a7d2-48da-b06f-e32ee47473b3 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:20.698592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e707230-e904-4f3f-9a21-6e252535309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:20.699537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3548f2-4024-4635-9d2f-57b706c1b23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:20.699685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e707230-e904-4f3f-9a21-6e252535309b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.700117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e707230-e904-4f3f-9a21-6e252535309b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.700306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3548f2-4024-4635-9d2f-57b706c1b23f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.700666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e707230-e904-4f3f-9a21-6e252535309b None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.700848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3548f2-4024-4635-9d2f-57b706c1b23f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.700961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3548f2-4024-4635-9d2f-57b706c1b23f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.701865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e707230-e904-4f3f-9a21-6e252535309b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:20.702421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e707230-e904-4f3f-9a21-6e252535309b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:20.704303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e707230-e904-4f3f-9a21-6e252535309b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:20.713757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3548f2-4024-4635-9d2f-57b706c1b23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:20.715666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3548f2-4024-4635-9d2f-57b706c1b23f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:20.720846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 313/631] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:20.722521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cea27-88c2-4bdb-817f-4f975d3cb35b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.722986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cea27-88c2-4bdb-817f-4f975d3cb35b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.723455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cea27-88c2-4bdb-817f-4f975d3cb35b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.726397 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 314/632] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:20.727407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cea27-88c2-4bdb-817f-4f975d3cb35b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-ca3548f2-4024-4635-9d2f-57b706c1b23f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:20.736861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:20.743448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:20.744341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:20.744341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:20.744341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:20.744341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 319/633] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:20.744341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3548f2-4024-4635-9d2f-57b706c1b23f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:20.819094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:20.842766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cea27-88c2-4bdb-817f-4f975d3cb35b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:20.872118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:20.881595 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3548f2-4024-4635-9d2f-57b706c1b23f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:20.886989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea5b23-ba1f-4301-a026-340ba3834387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:20.887660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea5b23-ba1f-4301-a026-340ba3834387 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.887939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea5b23-ba1f-4301-a026-340ba3834387 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.888259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea5b23-ba1f-4301-a026-340ba3834387 None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/8a59a4732ec14a838be9c838dbeb7fd0/roles/22cfc07169ee49d685af3262b384f78b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.904295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea5b23-ba1f-4301-a026-340ba3834387 None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=8a59a4732ec14a838be9c838dbeb7fd0, role_id=22cfc07169ee49d685af3262b384f78b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:20.905769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea5b23-ba1f-4301-a026-340ba3834387 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:20.921697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdda011-9d53-4c8f-b0d8-2a52c034eaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:20.922342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda011-9d53-4c8f-b0d8-2a52c034eaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.922631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda011-9d53-4c8f-b0d8-2a52c034eaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.922908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda011-9d53-4c8f-b0d8-2a52c034eaf0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.930964 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdda011-9d53-4c8f-b0d8-2a52c034eaf0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:20.932463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdda011-9d53-4c8f-b0d8-2a52c034eaf0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-9bdda011-9d53-4c8f-b0d8-2a52c034eaf0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:20.946382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:20.947547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:20.948586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 320/634] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:20.949556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521b557-5125-483d-bbd9-dd89159669d1 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:20.949556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521b557-5125-483d-bbd9-dd89159669d1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:20.949556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521b557-5125-483d-bbd9-dd89159669d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:20.968163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7521b557-5125-483d-bbd9-dd89159669d1 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:20.969406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7521b557-5125-483d-bbd9-dd89159669d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:20.977535 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 315/635] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:58:20 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/8a59a4732ec14a838be9c838dbeb7fd0/roles/22cfc07169ee49d685af3262b384f78b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:58:20.978490 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea5b23-ba1f-4301-a026-340ba3834387 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:21.066856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 321/636] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:21.068835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521b557-5125-483d-bbd9-dd89159669d1 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:21.108265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea5b23-ba1f-4301-a026-340ba3834387 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:21.141734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:21.151772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efeecd-8fac-432c-8aba-f9114cacfab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:21.152694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efeecd-8fac-432c-8aba-f9114cacfab7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:21.153125 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efeecd-8fac-432c-8aba-f9114cacfab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:21.153548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efeecd-8fac-432c-8aba-f9114cacfab7 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:21.154386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efeecd-8fac-432c-8aba-f9114cacfab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:21.154853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efeecd-8fac-432c-8aba-f9114cacfab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:21.156285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efeecd-8fac-432c-8aba-f9114cacfab7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:21.171980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 316/637] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:21.173093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efeecd-8fac-432c-8aba-f9114cacfab7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:21.208905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:21.229788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521b557-5125-483d-bbd9-dd89159669d1 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:21.276503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf78a7-6ca2-4c21-b54e-f11c58a63535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:21.277162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf78a7-6ca2-4c21-b54e-f11c58a63535 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:21.277444 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf78a7-6ca2-4c21-b54e-f11c58a63535 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:21.277722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf78a7-6ca2-4c21-b54e-f11c58a63535 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:21.293530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf78a7-6ca2-4c21-b54e-f11c58a63535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-2cbf78a7-6ca2-4c21-b54e-f11c58a63535 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:21.300401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:21.301385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:21.302197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 322/638] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:21.303017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf78a7-6ca2-4c21-b54e-f11c58a63535 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:21.318174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efeecd-8fac-432c-8aba-f9114cacfab7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:21.357074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cc96d-f7aa-4fdf-b869-988bdc5a962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:21.358036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc96d-f7aa-4fdf-b869-988bdc5a962f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:21.358516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc96d-f7aa-4fdf-b869-988bdc5a962f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:21.358822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc96d-f7aa-4fdf-b869-988bdc5a962f None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:21.359876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cc96d-f7aa-4fdf-b869-988bdc5a962f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:21.360611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cc96d-f7aa-4fdf-b869-988bdc5a962f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:21.363642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cc96d-f7aa-4fdf-b869-988bdc5a962f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:21.388150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 317/639] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 1 11:58:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:21.392252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cc96d-f7aa-4fdf-b869-988bdc5a962f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:21.437535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf78a7-6ca2-4c21-b54e-f11c58a63535 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:21.457235 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:21.479206 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14f67f-21b1-485f-a08d-c50393bc21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:21.480230 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f67f-21b1-485f-a08d-c50393bc21c3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:21.480738 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f67f-21b1-485f-a08d-c50393bc21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:21.481244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f67f-21b1-485f-a08d-c50393bc21c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:21.494738 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f67f-21b1-485f-a08d-c50393bc21c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:21.497668 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f67f-21b1-485f-a08d-c50393bc21c3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-1f14f67f-21b1-485f-a08d-c50393bc21c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:21.524858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:21.525852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:21.526757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 323/640] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 1 11:58:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:21.527338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14f67f-21b1-485f-a08d-c50393bc21c3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:21.538417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cc96d-f7aa-4fdf-b869-988bdc5a962f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:21.540709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:21.588762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bda1d-5d62-4db8-a7f3-d2b06e1a0aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:21.589611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bda1d-5d62-4db8-a7f3-d2b06e1a0aad None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:21.589896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bda1d-5d62-4db8-a7f3-d2b06e1a0aad None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:21.590236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bda1d-5d62-4db8-a7f3-d2b06e1a0aad None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:21.591350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bda1d-5d62-4db8-a7f3-d2b06e1a0aad None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:21.591810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bda1d-5d62-4db8-a7f3-d2b06e1a0aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:21.593670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bda1d-5d62-4db8-a7f3-d2b06e1a0aad None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:21.603719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 318/641] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:21.609145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bda1d-5d62-4db8-a7f3-d2b06e1a0aad None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:21.672910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14f67f-21b1-485f-a08d-c50393bc21c3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:21.723023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dae924-b370-491b-9064-986005e0ba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:21.723689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dae924-b370-491b-9064-986005e0ba85 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:21.723964 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dae924-b370-491b-9064-986005e0ba85 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:21.724249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dae924-b370-491b-9064-986005e0ba85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:21.736096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dae924-b370-491b-9064-986005e0ba85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f4dae924-b370-491b-9064-986005e0ba85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:21.741721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:21.749184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 324/642] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:21.750035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dae924-b370-491b-9064-986005e0ba85 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:21.761889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bda1d-5d62-4db8-a7f3-d2b06e1a0aad None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:21.780606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:21.823438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7d6bf-8d2b-490a-adb5-326b0a67c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:21.824337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7d6bf-8d2b-490a-adb5-326b0a67c248 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:21.824816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7d6bf-8d2b-490a-adb5-326b0a67c248 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:21.825332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7d6bf-8d2b-490a-adb5-326b0a67c248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:21.857918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:21.917849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dae924-b370-491b-9064-986005e0ba85 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:21.923558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7d6bf-8d2b-490a-adb5-326b0a67c248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:21.925076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7d6bf-8d2b-490a-adb5-326b0a67c248 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:21.965005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f6915-f16a-48a2-ae52-5965519a1b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:21.965624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f6915-f16a-48a2-ae52-5965519a1b3b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:21.965927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f6915-f16a-48a2-ae52-5965519a1b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:21.966203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f6915-f16a-48a2-ae52-5965519a1b3b None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:21.966955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f6915-f16a-48a2-ae52-5965519a1b3b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:21.967263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f6915-f16a-48a2-ae52-5965519a1b3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:21.968789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f6915-f16a-48a2-ae52-5965519a1b3b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:21.997933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 325/643] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 1 11:58:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:21.997933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f6915-f16a-48a2-ae52-5965519a1b3b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:22.084383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 319/644] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:22.084383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7d6bf-8d2b-490a-adb5-326b0a67c248 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:22.095699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:22.127671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f6915-f16a-48a2-ae52-5965519a1b3b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:22.164059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:22.172934 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c475a-0fd6-4905-b336-57779c7f5003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:22.173585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c475a-0fd6-4905-b336-57779c7f5003 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:22.173779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c475a-0fd6-4905-b336-57779c7f5003 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:22.174053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c475a-0fd6-4905-b336-57779c7f5003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:22.187854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c475a-0fd6-4905-b336-57779c7f5003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:22.189634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c475a-0fd6-4905-b336-57779c7f5003 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-887c475a-0fd6-4905-b336-57779c7f5003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:22.211492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:22.212845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:22.218986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:22.218986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:22.218986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:22.218986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 326/645] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:22.218986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c475a-0fd6-4905-b336-57779c7f5003 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:22.231016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7d6bf-8d2b-490a-adb5-326b0a67c248 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:22.281373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9b6e2-8a8a-4621-a33d-0e5446759f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:22.282409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9b6e2-8a8a-4621-a33d-0e5446759f17 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:22.282912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9b6e2-8a8a-4621-a33d-0e5446759f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:22.283424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9b6e2-8a8a-4621-a33d-0e5446759f17 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:22.284746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9b6e2-8a8a-4621-a33d-0e5446759f17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:22.285309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9b6e2-8a8a-4621-a33d-0e5446759f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:22.287757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9b6e2-8a8a-4621-a33d-0e5446759f17 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:22.305245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 320/646] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:22.306715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9b6e2-8a8a-4621-a33d-0e5446759f17 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:22.344943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c475a-0fd6-4905-b336-57779c7f5003 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:22.390949 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e221f-66e9-4302-8cda-ba884645bda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:22.391574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e221f-66e9-4302-8cda-ba884645bda6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:22.392086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e221f-66e9-4302-8cda-ba884645bda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:22.392404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e221f-66e9-4302-8cda-ba884645bda6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:22.410552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:22.452512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:22.466671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9b6e2-8a8a-4621-a33d-0e5446759f17 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:22.483981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e221f-66e9-4302-8cda-ba884645bda6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:22.485600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e221f-66e9-4302-8cda-ba884645bda6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:22.506438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fce1d-f9f4-472f-9ee4-6f1d4e19be75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:22.508077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fce1d-f9f4-472f-9ee4-6f1d4e19be75 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:22.508833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fce1d-f9f4-472f-9ee4-6f1d4e19be75 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:22.509287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fce1d-f9f4-472f-9ee4-6f1d4e19be75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:22.525607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fce1d-f9f4-472f-9ee4-6f1d4e19be75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:22.527366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fce1d-f9f4-472f-9ee4-6f1d4e19be75 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9f6fce1d-f9f4-472f-9ee4-6f1d4e19be75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:22.544969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:22.547056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:22.549475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:22.549475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:22.549475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:22.551071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 321/647] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:22.552010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fce1d-f9f4-472f-9ee4-6f1d4e19be75 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:22.629674 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 327/648] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:22.631215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e221f-66e9-4302-8cda-ba884645bda6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:22.699794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fce1d-f9f4-472f-9ee4-6f1d4e19be75 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:22.728424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:22.748620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406eb0e-63cb-4756-bf3b-4db10b0d1318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:22.749843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406eb0e-63cb-4756-bf3b-4db10b0d1318 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:22.750511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406eb0e-63cb-4756-bf3b-4db10b0d1318 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:22.751017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406eb0e-63cb-4756-bf3b-4db10b0d1318 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:22.752197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406eb0e-63cb-4756-bf3b-4db10b0d1318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:22.752780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406eb0e-63cb-4756-bf3b-4db10b0d1318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:22.754858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406eb0e-63cb-4756-bf3b-4db10b0d1318 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:22.762345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:22.769600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 322/649] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:22.770548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406eb0e-63cb-4756-bf3b-4db10b0d1318 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:22.807392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e221f-66e9-4302-8cda-ba884645bda6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:22.846983 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552ca89-c341-468e-a156-ec2b47e2455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:22.848124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552ca89-c341-468e-a156-ec2b47e2455c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:22.848544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552ca89-c341-468e-a156-ec2b47e2455c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:22.849195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552ca89-c341-468e-a156-ec2b47e2455c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:22.863745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552ca89-c341-468e-a156-ec2b47e2455c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:22.865238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552ca89-c341-468e-a156-ec2b47e2455c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-d552ca89-c341-468e-a156-ec2b47e2455c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:22.883588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:22.884745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:22.885610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:22.885610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:22.885610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:22.885610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 328/650] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:22.885943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552ca89-c341-468e-a156-ec2b47e2455c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:22.899767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406eb0e-63cb-4756-bf3b-4db10b0d1318 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:22.960661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193456b3-203e-4337-aef3-975396dc59a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:22.961786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193456b3-203e-4337-aef3-975396dc59a3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:22.962411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193456b3-203e-4337-aef3-975396dc59a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:22.963048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193456b3-203e-4337-aef3-975396dc59a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:22.964341 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193456b3-203e-4337-aef3-975396dc59a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:22.965032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193456b3-203e-4337-aef3-975396dc59a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:22.967687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193456b3-203e-4337-aef3-975396dc59a3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:22.987363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 323/651] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:22.989001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193456b3-203e-4337-aef3-975396dc59a3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:23.015010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552ca89-c341-468e-a156-ec2b47e2455c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:23.045176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:23.050424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:23.053236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ab705-ee8f-403f-aa12-506ca7b42330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:23.053865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ab705-ee8f-403f-aa12-506ca7b42330 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:23.057608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ab705-ee8f-403f-aa12-506ca7b42330 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:23.057608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ab705-ee8f-403f-aa12-506ca7b42330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:23.069443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ab705-ee8f-403f-aa12-506ca7b42330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:23.071418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ab705-ee8f-403f-aa12-506ca7b42330 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6f0ab705-ee8f-403f-aa12-506ca7b42330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:23.088750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:23.090611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:23.092375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:23.092375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:23.092375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:23.092375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 329/652] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:23.092375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ab705-ee8f-403f-aa12-506ca7b42330 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:23.118024 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193456b3-203e-4337-aef3-975396dc59a3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:23.166213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566e636-e3e3-4a85-9d11-1d82c898dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:23.166881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566e636-e3e3-4a85-9d11-1d82c898dac3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:23.167157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566e636-e3e3-4a85-9d11-1d82c898dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:23.167436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566e636-e3e3-4a85-9d11-1d82c898dac3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:23.176697 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566e636-e3e3-4a85-9d11-1d82c898dac3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:23.178218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566e636-e3e3-4a85-9d11-1d82c898dac3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6566e636-e3e3-4a85-9d11-1d82c898dac3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:23.191121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:23.192362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 324/653] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:23.194245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566e636-e3e3-4a85-9d11-1d82c898dac3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:23.248365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ab705-ee8f-403f-aa12-506ca7b42330 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:23.310550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc94467-efce-4923-ad3b-b3d65b0afeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:23.311328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc94467-efce-4923-ad3b-b3d65b0afeee None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:23.311790 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc94467-efce-4923-ad3b-b3d65b0afeee None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:23.312265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc94467-efce-4923-ad3b-b3d65b0afeee None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:23.313158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc94467-efce-4923-ad3b-b3d65b0afeee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:23.313645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc94467-efce-4923-ad3b-b3d65b0afeee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:23.316075 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc94467-efce-4923-ad3b-b3d65b0afeee None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:23.321323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566e636-e3e3-4a85-9d11-1d82c898dac3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:23.322987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:23.338105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 330/654] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:23.340415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5279f1-0a40-4498-87b1-e81b61cf448e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:23.340911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5279f1-0a40-4498-87b1-e81b61cf448e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:23.341388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5279f1-0a40-4498-87b1-e81b61cf448e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:23.344257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 331/655] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:23.344714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5279f1-0a40-4498-87b1-e81b61cf448e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:23.376067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97631d-6ba5-497c-9b7d-40c685da774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:23.377081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97631d-6ba5-497c-9b7d-40c685da774a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:23.377533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97631d-6ba5-497c-9b7d-40c685da774a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:23.377983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97631d-6ba5-497c-9b7d-40c685da774a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:23.390129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97631d-6ba5-497c-9b7d-40c685da774a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:23.392644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97631d-6ba5-497c-9b7d-40c685da774a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:23.404986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-dd97631d-6ba5-497c-9b7d-40c685da774a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:23.408550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:23.418164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:23.430882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:23.430882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:23.430882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:23.430882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:23.430882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:23.430882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:23.430882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:23.430882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:23.430882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 325/656] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:23.430882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97631d-6ba5-497c-9b7d-40c685da774a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:23.477720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5279f1-0a40-4498-87b1-e81b61cf448e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:23.518337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe4d93-42da-42de-8eea-5764cf76c7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:23.518885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe4d93-42da-42de-8eea-5764cf76c7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:23.519204 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe4d93-42da-42de-8eea-5764cf76c7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:23.519485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe4d93-42da-42de-8eea-5764cf76c7c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:23.520143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe4d93-42da-42de-8eea-5764cf76c7c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:23.520471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe4d93-42da-42de-8eea-5764cf76c7c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:23.521869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe4d93-42da-42de-8eea-5764cf76c7c7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:23.525367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97631d-6ba5-497c-9b7d-40c685da774a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:23.534846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 332/657] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:23.535718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe4d93-42da-42de-8eea-5764cf76c7c7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:23.585052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477d04a-458b-4007-af7f-82e1de267e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:23.586599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d04a-458b-4007-af7f-82e1de267e80 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:23.587103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d04a-458b-4007-af7f-82e1de267e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:23.587587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d04a-458b-4007-af7f-82e1de267e80 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:23.589010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477d04a-458b-4007-af7f-82e1de267e80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:23.589565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477d04a-458b-4007-af7f-82e1de267e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:23.591531 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477d04a-458b-4007-af7f-82e1de267e80 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:23.623568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 326/658] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Sep 1 11:58:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:23.624957 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16362bc-0d33-4b65-8017-02365917b181 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:23.625328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16362bc-0d33-4b65-8017-02365917b181 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:23.625612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16362bc-0d33-4b65-8017-02365917b181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:23.649551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f16362bc-0d33-4b65-8017-02365917b181 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:23.651133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f16362bc-0d33-4b65-8017-02365917b181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:23.653995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:23.657640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe4d93-42da-42de-8eea-5764cf76c7c7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:23.668732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:23.716628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f77e-5b37-43fc-acf9-fefbceef0aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:23.717653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f77e-5b37-43fc-acf9-fefbceef0aed None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:23.718132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f77e-5b37-43fc-acf9-fefbceef0aed None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:23.718591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361f77e-5b37-43fc-acf9-fefbceef0aed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:23.732466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361f77e-5b37-43fc-acf9-fefbceef0aed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:23.742068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 327/659] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:23.742068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16362bc-0d33-4b65-8017-02365917b181 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:23.742382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361f77e-5b37-43fc-acf9-fefbceef0aed None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-9361f77e-5b37-43fc-acf9-fefbceef0aed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:23.757856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:23.758896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:23.759803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:23.759803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:23.759803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:23.759803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:23.759803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:23.759803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:23.759803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:23.759803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:23.759803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 11:58:23.759803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:23.760386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 333/660] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:23.761301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f77e-5b37-43fc-acf9-fefbceef0aed None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:23.885683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361f77e-5b37-43fc-acf9-fefbceef0aed None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:23.932182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16362bc-0d33-4b65-8017-02365917b181 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:23.934782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6a6c0-597d-4eb7-a353-2863fc0c1373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:23.935445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a6c0-597d-4eb7-a353-2863fc0c1373 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:23.935722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a6c0-597d-4eb7-a353-2863fc0c1373 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:23.935992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a6c0-597d-4eb7-a353-2863fc0c1373 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:23.944378 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6a6c0-597d-4eb7-a353-2863fc0c1373 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:23.946393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6a6c0-597d-4eb7-a353-2863fc0c1373 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-dcc6a6c0-597d-4eb7-a353-2863fc0c1373 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:23.959235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:23.961486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:23.963167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:23.963167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:23.963167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:23.963167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:23.963167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:23.963167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:23.963167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:23.963167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:23.966040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 334/661] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:23.967051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6a6c0-597d-4eb7-a353-2863fc0c1373 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:23.997727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:24.008010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efe5a2-83b3-4ae5-ae4b-1b4778a90f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:24.012788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efe5a2-83b3-4ae5-ae4b-1b4778a90f3a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:24.012788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efe5a2-83b3-4ae5-ae4b-1b4778a90f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:24.012788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efe5a2-83b3-4ae5-ae4b-1b4778a90f3a None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:24.012788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efe5a2-83b3-4ae5-ae4b-1b4778a90f3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:24.012788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efe5a2-83b3-4ae5-ae4b-1b4778a90f3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:24.012788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efe5a2-83b3-4ae5-ae4b-1b4778a90f3a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:24.025303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 328/662] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:24.026278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efe5a2-83b3-4ae5-ae4b-1b4778a90f3a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:24.040544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:24.116099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6a6c0-597d-4eb7-a353-2863fc0c1373 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:24.155497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efe5a2-83b3-4ae5-ae4b-1b4778a90f3a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:24.165762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af122f-577f-447f-aa72-7abe4546e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:24.166383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af122f-577f-447f-aa72-7abe4546e245 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:24.166663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af122f-577f-447f-aa72-7abe4546e245 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:24.166942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af122f-577f-447f-aa72-7abe4546e245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:24.199506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732c84e-6a37-4084-b412-6c49adf3134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:24.200262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c84e-6a37-4084-b412-6c49adf3134e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:24.200815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c84e-6a37-4084-b412-6c49adf3134e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:24.201151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c84e-6a37-4084-b412-6c49adf3134e None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:24.202050 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732c84e-6a37-4084-b412-6c49adf3134e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:24.202510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732c84e-6a37-4084-b412-6c49adf3134e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:24.204101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732c84e-6a37-4084-b412-6c49adf3134e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:24.227598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 329/663] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Sep 1 11:58:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:24.228863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732c84e-6a37-4084-b412-6c49adf3134e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:24.259123 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af122f-577f-447f-aa72-7abe4546e245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:24.261482 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af122f-577f-447f-aa72-7abe4546e245 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:24.290889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:24.317228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:24.355752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732c84e-6a37-4084-b412-6c49adf3134e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:24.392994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 335/664] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:24.392994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af122f-577f-447f-aa72-7abe4546e245 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:24.403091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336de17-1e51-468d-b7cd-00d5d348275b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:24.404123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336de17-1e51-468d-b7cd-00d5d348275b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:24.404642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336de17-1e51-468d-b7cd-00d5d348275b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:24.405209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336de17-1e51-468d-b7cd-00d5d348275b None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:24.406558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336de17-1e51-468d-b7cd-00d5d348275b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:24.406851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336de17-1e51-468d-b7cd-00d5d348275b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:24.409719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336de17-1e51-468d-b7cd-00d5d348275b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:24.426047 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 330/665] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:24.426923 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336de17-1e51-468d-b7cd-00d5d348275b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:24.539689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af122f-577f-447f-aa72-7abe4546e245 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:24.548850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336de17-1e51-468d-b7cd-00d5d348275b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:24.568348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:24.582001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:24.586094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277b66e-2e28-4fbd-8990-22e20c38a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:24.587168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277b66e-2e28-4fbd-8990-22e20c38a93c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:24.587557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277b66e-2e28-4fbd-8990-22e20c38a93c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:24.589026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277b66e-2e28-4fbd-8990-22e20c38a93c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:24.594092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f892c7-b2bf-4d1e-805c-231d20bdb06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:24.595036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f892c7-b2bf-4d1e-805c-231d20bdb06d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:24.595481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f892c7-b2bf-4d1e-805c-231d20bdb06d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:24.595925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f892c7-b2bf-4d1e-805c-231d20bdb06d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:24.597183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f892c7-b2bf-4d1e-805c-231d20bdb06d None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=76b84587baf0432c800a6278d7095cfd) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:24.597692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f892c7-b2bf-4d1e-805c-231d20bdb06d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:24.600182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f892c7-b2bf-4d1e-805c-231d20bdb06d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:24.606485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277b66e-2e28-4fbd-8990-22e20c38a93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:24.621249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 331/666] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:24 2022] GET /identity/v3/role_assignments?user.id=76b84587baf0432c800a6278d7095cfd&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:24.621249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f892c7-b2bf-4d1e-805c-231d20bdb06d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-7277b66e-2e28-4fbd-8990-22e20c38a93c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:24.641188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:24.643226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 336/667] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:24.645425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277b66e-2e28-4fbd-8990-22e20c38a93c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:24.778995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f892c7-b2bf-4d1e-805c-231d20bdb06d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:24.807274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277b66e-2e28-4fbd-8990-22e20c38a93c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:24.822832 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a8eb-a59d-41cd-af73-c93a43a4a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:24.823553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a8eb-a59d-41cd-af73-c93a43a4a084 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:24.823897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a8eb-a59d-41cd-af73-c93a43a4a084 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:24.824253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a8eb-a59d-41cd-af73-c93a43a4a084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:24.867686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7cd12-ef9c-4ad9-b3ae-5b5b9d2e1524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:24.868364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7cd12-ef9c-4ad9-b3ae-5b5b9d2e1524 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:24.868634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7cd12-ef9c-4ad9-b3ae-5b5b9d2e1524 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:24.868904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7cd12-ef9c-4ad9-b3ae-5b5b9d2e1524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:24.889843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7cd12-ef9c-4ad9-b3ae-5b5b9d2e1524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:24.892652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7cd12-ef9c-4ad9-b3ae-5b5b9d2e1524 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f4b7cd12-ef9c-4ad9-b3ae-5b5b9d2e1524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:24.915525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:24.917560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:24.922480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:24.922480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:24.922480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:24.922480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 337/668] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:24.922480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7cd12-ef9c-4ad9-b3ae-5b5b9d2e1524 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:24.938522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:24.954850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a8eb-a59d-41cd-af73-c93a43a4a084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:24.960195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a8eb-a59d-41cd-af73-c93a43a4a084 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:24.967836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:25.082109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7cd12-ef9c-4ad9-b3ae-5b5b9d2e1524 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:25.134718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 332/669] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:25.135985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a8eb-a59d-41cd-af73-c93a43a4a084 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:25.149325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a42ede-d3a2-4833-aca1-589e7ba091a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:25.150483 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a42ede-d3a2-4833-aca1-589e7ba091a5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:25.151061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a42ede-d3a2-4833-aca1-589e7ba091a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:25.151623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a42ede-d3a2-4833-aca1-589e7ba091a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:25.153131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a42ede-d3a2-4833-aca1-589e7ba091a5 None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=7790d6ec0e524ee6a31fd06fda9c4ac7) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:25.153748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a42ede-d3a2-4833-aca1-589e7ba091a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:25.156519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a42ede-d3a2-4833-aca1-589e7ba091a5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:25.174512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 338/670] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:24 2022] GET /identity/v3/role_assignments?user.id=7790d6ec0e524ee6a31fd06fda9c4ac7&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:25.174512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a42ede-d3a2-4833-aca1-589e7ba091a5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:25.326725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:25.347171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a8eb-a59d-41cd-af73-c93a43a4a084 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:25.378471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:25.389842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a42ede-d3a2-4833-aca1-589e7ba091a5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:25.429725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be033-1e83-45f0-adef-3354db6174d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:25.430847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be033-1e83-45f0-adef-3354db6174d1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:25.431352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be033-1e83-45f0-adef-3354db6174d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:25.431849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be033-1e83-45f0-adef-3354db6174d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:25.434139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2be033-1e83-45f0-adef-3354db6174d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:25.434139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2be033-1e83-45f0-adef-3354db6174d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:25.436710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2be033-1e83-45f0-adef-3354db6174d1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:25.451614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 333/671] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:25.452749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be033-1e83-45f0-adef-3354db6174d1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:25.459253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787af375-7fce-467a-96bc-6f8d58433a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:25.460549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787af375-7fce-467a-96bc-6f8d58433a4c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:25.461122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787af375-7fce-467a-96bc-6f8d58433a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:25.461710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787af375-7fce-467a-96bc-6f8d58433a4c None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:25.463022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787af375-7fce-467a-96bc-6f8d58433a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:25.463559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787af375-7fce-467a-96bc-6f8d58433a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:25.467435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787af375-7fce-467a-96bc-6f8d58433a4c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:25.491140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 339/672] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:25.493715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787af375-7fce-467a-96bc-6f8d58433a4c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:25.612596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be033-1e83-45f0-adef-3354db6174d1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:25.665422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055845cb-fe95-42aa-88e1-fd5c83f5903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:25.666079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055845cb-fe95-42aa-88e1-fd5c83f5903a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:25.666358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055845cb-fe95-42aa-88e1-fd5c83f5903a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:25.666632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055845cb-fe95-42aa-88e1-fd5c83f5903a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:25.684690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055845cb-fe95-42aa-88e1-fd5c83f5903a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:25.684690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055845cb-fe95-42aa-88e1-fd5c83f5903a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:25.703397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787af375-7fce-467a-96bc-6f8d58433a4c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-055845cb-fe95-42aa-88e1-fd5c83f5903a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:25.704015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:25.705844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:25.707465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:25.707465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:25.707465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:25.707465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 334/673] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:25.707465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055845cb-fe95-42aa-88e1-fd5c83f5903a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:25.718505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:25.770884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c43ca1-6562-4457-ac1e-da2a96dfee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:25.773257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c43ca1-6562-4457-ac1e-da2a96dfee87 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:25.774071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c43ca1-6562-4457-ac1e-da2a96dfee87 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:25.774825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c43ca1-6562-4457-ac1e-da2a96dfee87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:25.796743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c43ca1-6562-4457-ac1e-da2a96dfee87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:25.800153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c43ca1-6562-4457-ac1e-da2a96dfee87 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a3c43ca1-6562-4457-ac1e-da2a96dfee87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:25.830045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:25.831914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:25.834241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:25.834241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:25.834241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:25.837227 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055845cb-fe95-42aa-88e1-fd5c83f5903a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:25.838957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 340/674] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:25.841021 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c43ca1-6562-4457-ac1e-da2a96dfee87 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:25.863340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:25.884705 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4c0b7-a388-4c2e-87f0-937294b95893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:25.885356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4c0b7-a388-4c2e-87f0-937294b95893 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:25.885633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4c0b7-a388-4c2e-87f0-937294b95893 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:25.885950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4c0b7-a388-4c2e-87f0-937294b95893 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:25.895630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4c0b7-a388-4c2e-87f0-937294b95893 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:25.897518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4c0b7-a388-4c2e-87f0-937294b95893 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e5f4c0b7-a388-4c2e-87f0-937294b95893 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:25.913786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:25.915324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:25.916994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:25.916994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:25.916994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:25.916994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:25.916994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:25.916994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:25.916994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:25.916994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:25.916994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 335/675] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:25.916994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4c0b7-a388-4c2e-87f0-937294b95893 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:26.003186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:26.035235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c43ca1-6562-4457-ac1e-da2a96dfee87 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:26.046973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4c0b7-a388-4c2e-87f0-937294b95893 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:26.105421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fa6e3-cee9-46b8-a1ea-e0adfcc1a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:26.106443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fa6e3-cee9-46b8-a1ea-e0adfcc1a150 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:26.107058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fa6e3-cee9-46b8-a1ea-e0adfcc1a150 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:26.107557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fa6e3-cee9-46b8-a1ea-e0adfcc1a150 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:26.108842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fa6e3-cee9-46b8-a1ea-e0adfcc1a150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:26.110392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fa6e3-cee9-46b8-a1ea-e0adfcc1a150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:26.112252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fa6e3-cee9-46b8-a1ea-e0adfcc1a150 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:26.117164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79ebc6-230c-4778-b81b-76f407f082c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:26.118650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79ebc6-230c-4778-b81b-76f407f082c5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:26.119393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79ebc6-230c-4778-b81b-76f407f082c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:26.120179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79ebc6-230c-4778-b81b-76f407f082c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:26.121684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79ebc6-230c-4778-b81b-76f407f082c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:26.122557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79ebc6-230c-4778-b81b-76f407f082c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:26.125591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79ebc6-230c-4778-b81b-76f407f082c5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:26.137860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 336/676] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:26.139369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fa6e3-cee9-46b8-a1ea-e0adfcc1a150 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:26.151509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 341/677] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:26.154094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79ebc6-230c-4778-b81b-76f407f082c5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:26.295325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:26.360139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fa6e3-cee9-46b8-a1ea-e0adfcc1a150 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:26.372069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79ebc6-230c-4778-b81b-76f407f082c5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:26.415449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:26.432610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b0343-9c18-4607-9679-c36e9db3fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:26.434376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0343-9c18-4607-9679-c36e9db3fab2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:26.435180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0343-9c18-4607-9679-c36e9db3fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:26.436025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0343-9c18-4607-9679-c36e9db3fab2 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:26.437663 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b0343-9c18-4607-9679-c36e9db3fab2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:26.438593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b0343-9c18-4607-9679-c36e9db3fab2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:26.441766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b0343-9c18-4607-9679-c36e9db3fab2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:26.450185 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8690-ef37-4f73-81f2-0147f766da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:26.451318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8690-ef37-4f73-81f2-0147f766da0e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:26.451768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8690-ef37-4f73-81f2-0147f766da0e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:26.452186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8690-ef37-4f73-81f2-0147f766da0e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:26.470442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 337/678] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:26.470939 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c8690-ef37-4f73-81f2-0147f766da0e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:26.472785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b0343-9c18-4607-9679-c36e9db3fab2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:26.473732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c8690-ef37-4f73-81f2-0147f766da0e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-5e2c8690-ef37-4f73-81f2-0147f766da0e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:26.501113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:26.503054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:26.506072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:26.506072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:26.506072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:26.506072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:26.506072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:26.506072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:26.506072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:26.506072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:26.506072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:26.506072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:26.511526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 342/679] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:26.513644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8690-ef37-4f73-81f2-0147f766da0e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:26.706853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b0343-9c18-4607-9679-c36e9db3fab2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:26.731462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8690-ef37-4f73-81f2-0147f766da0e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:26.787918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:26.798255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5820-aa81-4933-912d-83ccbe86260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:26.808370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5820-aa81-4933-912d-83ccbe86260d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:26.808370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5820-aa81-4933-912d-83ccbe86260d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:26.808370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5820-aa81-4933-912d-83ccbe86260d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:26.808662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa16f6-7875-40e6-9c49-050d0ef8ec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:26.808662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa16f6-7875-40e6-9c49-050d0ef8ec20 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:26.808662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa16f6-7875-40e6-9c49-050d0ef8ec20 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:26.808662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa16f6-7875-40e6-9c49-050d0ef8ec20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:26.808923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa16f6-7875-40e6-9c49-050d0ef8ec20 None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=d0eb27228bae4b6d97715c0c46032030) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:26.808923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa16f6-7875-40e6-9c49-050d0ef8ec20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:26.811009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa16f6-7875-40e6-9c49-050d0ef8ec20 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:26.814340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5820-aa81-4933-912d-83ccbe86260d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:26.817107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5820-aa81-4933-912d-83ccbe86260d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:26.821926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 343/680] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:26 2022] GET /identity/v3/role_assignments?user.id=d0eb27228bae4b6d97715c0c46032030&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:26.824366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa16f6-7875-40e6-9c49-050d0ef8ec20 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b27c5820-aa81-4933-912d-83ccbe86260d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:26.839904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:26.842011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:26.844059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:26.844059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:26.844059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:26.844059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:26.844059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:26.844059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:26.844059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:26.844059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:26.844059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 338/681] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:26.845178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef6915-21df-4e26-8f4d-05de3160264a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:26.845178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef6915-21df-4e26-8f4d-05de3160264a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:26.846303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef6915-21df-4e26-8f4d-05de3160264a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:26.849363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 339/682] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:26.857959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef6915-21df-4e26-8f4d-05de3160264a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:26.978080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:27.010769 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa16f6-7875-40e6-9c49-050d0ef8ec20 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:27.048085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef6915-21df-4e26-8f4d-05de3160264a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:27.094346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27ede6-06c6-4cbc-b6b3-940da4800c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:27.094971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ede6-06c6-4cbc-b6b3-940da4800c06 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:27.095250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ede6-06c6-4cbc-b6b3-940da4800c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:27.095526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ede6-06c6-4cbc-b6b3-940da4800c06 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:27.096315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27ede6-06c6-4cbc-b6b3-940da4800c06 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:27.096615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27ede6-06c6-4cbc-b6b3-940da4800c06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:27.098197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27ede6-06c6-4cbc-b6b3-940da4800c06 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:27.119109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 344/683] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 1 11:58:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:27.121015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80399a96-3bb6-443c-995a-8c6e7684e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:27.121369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeede35-eb64-4895-a828-0ddb4434cffe None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:27.121641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeede35-eb64-4895-a828-0ddb4434cffe None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:27.121889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeede35-eb64-4895-a828-0ddb4434cffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:27.123304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80399a96-3bb6-443c-995a-8c6e7684e0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:27.124113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80399a96-3bb6-443c-995a-8c6e7684e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:27.125214 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80399a96-3bb6-443c-995a-8c6e7684e0b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:27.127301 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80399a96-3bb6-443c-995a-8c6e7684e0b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:27.128203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80399a96-3bb6-443c-995a-8c6e7684e0b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:27.131691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80399a96-3bb6-443c-995a-8c6e7684e0b7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:27.142040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0eeede35-eb64-4895-a828-0ddb4434cffe None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:27.143260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0eeede35-eb64-4895-a828-0ddb4434cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:27.160268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 340/684] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:27.160268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80399a96-3bb6-443c-995a-8c6e7684e0b7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:27.206652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:27.236936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 345/685] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:27.245344 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeede35-eb64-4895-a828-0ddb4434cffe None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:27.352093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80399a96-3bb6-443c-995a-8c6e7684e0b7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:27.380757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:27.419040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbbc24-e681-4a8a-816c-df174f355112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:27.421521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbbc24-e681-4a8a-816c-df174f355112 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:27.421913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbbc24-e681-4a8a-816c-df174f355112 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:27.422283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbbc24-e681-4a8a-816c-df174f355112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:27.516984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeede35-eb64-4895-a828-0ddb4434cffe None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:27.576161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbbc24-e681-4a8a-816c-df174f355112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:27.579084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbbc24-e681-4a8a-816c-df174f355112 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:27.594541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274a9f0-491f-4943-9410-f982d8a52701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:27.595222 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274a9f0-491f-4943-9410-f982d8a52701 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:27.595508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274a9f0-491f-4943-9410-f982d8a52701 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:27.595783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274a9f0-491f-4943-9410-f982d8a52701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:27.596565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274a9f0-491f-4943-9410-f982d8a52701 None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=afb45915b43b471a84fbd363fade7241) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:27.596876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274a9f0-491f-4943-9410-f982d8a52701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:27.598693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274a9f0-491f-4943-9410-f982d8a52701 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:27.606712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 346/686] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:27 2022] GET /identity/v3/role_assignments?user.id=afb45915b43b471a84fbd363fade7241&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 608 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:27.607727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274a9f0-491f-4943-9410-f982d8a52701 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:27.664590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:27.734992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274a9f0-491f-4943-9410-f982d8a52701 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:27.780341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c5f97-036a-4c7d-954b-b04231b6d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:27.781246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5f97-036a-4c7d-954b-b04231b6d5ad None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:27.781670 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5f97-036a-4c7d-954b-b04231b6d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:27.782109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c5f97-036a-4c7d-954b-b04231b6d5ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:27.797053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c5f97-036a-4c7d-954b-b04231b6d5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:27.799915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c5f97-036a-4c7d-954b-b04231b6d5ad None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a11c5f97-036a-4c7d-954b-b04231b6d5ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:27.818924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:27.820707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:27.821607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:27.821607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:27.821607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:27.823529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 347/687] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:27.830036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c5f97-036a-4c7d-954b-b04231b6d5ad None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:27.836811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 341/688] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:27.849942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbbc24-e681-4a8a-816c-df174f355112 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:27.873082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:27.956330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:27.963972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c5f97-036a-4c7d-954b-b04231b6d5ad None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:28.028696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c8a7a-c8a8-457a-a808-aaedd35e8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:28.029611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c8a7a-c8a8-457a-a808-aaedd35e8703 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:28.030045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c8a7a-c8a8-457a-a808-aaedd35e8703 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:28.030547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c8a7a-c8a8-457a-a808-aaedd35e8703 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:28.031372 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c8a7a-c8a8-457a-a808-aaedd35e8703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:28.031832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c8a7a-c8a8-457a-a808-aaedd35e8703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:28.033569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c8a7a-c8a8-457a-a808-aaedd35e8703 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:28.053870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 348/689] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:28.061236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c8a7a-c8a8-457a-a808-aaedd35e8703 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:28.130484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbbc24-e681-4a8a-816c-df174f355112 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:28.192064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcd3c2-ad0c-4718-8244-088e48ba0497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:28.193163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcd3c2-ad0c-4718-8244-088e48ba0497 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:28.194033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcd3c2-ad0c-4718-8244-088e48ba0497 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:28.195897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcd3c2-ad0c-4718-8244-088e48ba0497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:28.240909 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcd3c2-ad0c-4718-8244-088e48ba0497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:28.244378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcd3c2-ad0c-4718-8244-088e48ba0497 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:28.261298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c8a7a-c8a8-457a-a808-aaedd35e8703 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f6bcd3c2-ad0c-4718-8244-088e48ba0497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:28.294876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:28.296403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:28.297554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:28.297554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:28.297554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:28.309695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 342/690] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:28.315770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcd3c2-ad0c-4718-8244-088e48ba0497 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:28.326960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ffc2e-235b-4341-b44e-181a277ca96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:28.334170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ffc2e-235b-4341-b44e-181a277ca96a None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:28.334607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ffc2e-235b-4341-b44e-181a277ca96a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:28.335550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ffc2e-235b-4341-b44e-181a277ca96a None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:28.336424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ffc2e-235b-4341-b44e-181a277ca96a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:28.338034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ffc2e-235b-4341-b44e-181a277ca96a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:28.410482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:28.436356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 349/691] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:58:28 2022] POST /identity/v3/users => generated 254 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:58:28.470319 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcd3c2-ad0c-4718-8244-088e48ba0497 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:28.479355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30ac7-b37e-460f-8402-592ae31c1b6d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:28.479810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30ac7-b37e-460f-8402-592ae31c1b6d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:28.480318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30ac7-b37e-460f-8402-592ae31c1b6d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:28.483263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 350/692] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:28.492245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3fda-ba90-46b8-94bb-70fe08354d81 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:28.492746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3fda-ba90-46b8-94bb-70fe08354d81 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:28.493224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3fda-ba90-46b8-94bb-70fe08354d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:28.513180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f62b-91bf-4dc4-996e-d76da3846ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:28.513803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f62b-91bf-4dc4-996e-d76da3846ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:28.514082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f62b-91bf-4dc4-996e-d76da3846ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:28.514359 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f62b-91bf-4dc4-996e-d76da3846ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:28.515026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f62b-91bf-4dc4-996e-d76da3846ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:28.515332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f62b-91bf-4dc4-996e-d76da3846ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:28.516892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f62b-91bf-4dc4-996e-d76da3846ad3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:28.527778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-65fb3fda-ba90-46b8-94bb-70fe08354d81 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:28.531152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-65fb3fda-ba90-46b8-94bb-70fe08354d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:28.532287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 343/693] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:28.538105 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f62b-91bf-4dc4-996e-d76da3846ad3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:28.557294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:28.717828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 351/694] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:28.734048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f62b-91bf-4dc4-996e-d76da3846ad3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:28.755517 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:28.776180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4942c0-3299-41df-bd35-e5c13378b333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:28.779192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4942c0-3299-41df-bd35-e5c13378b333 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:28.779192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4942c0-3299-41df-bd35-e5c13378b333 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:28.779192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4942c0-3299-41df-bd35-e5c13378b333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:28.785594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4942c0-3299-41df-bd35-e5c13378b333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:28.787073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4942c0-3299-41df-bd35-e5c13378b333 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ba4942c0-3299-41df-bd35-e5c13378b333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:28.800875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:28.803049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:28.805527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:28.805527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:28.805527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:28.805527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:28.805527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:28.805527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:28.805527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:28.805527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:28.805527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 344/695] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:28.809350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb3fda-ba90-46b8-94bb-70fe08354d81 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:28.935677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb3fda-ba90-46b8-94bb-70fe08354d81 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:28.977333 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae4990-c077-49ad-8e21-2fbf19f297c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:28.978845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae4990-c077-49ad-8e21-2fbf19f297c3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:28.979609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae4990-c077-49ad-8e21-2fbf19f297c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:28.980395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae4990-c077-49ad-8e21-2fbf19f297c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:28.981980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae4990-c077-49ad-8e21-2fbf19f297c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:28.982811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae4990-c077-49ad-8e21-2fbf19f297c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:28.985807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae4990-c077-49ad-8e21-2fbf19f297c3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:29.013641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 352/696] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:29.019885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4942c0-3299-41df-bd35-e5c13378b333 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:29.194388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4942c0-3299-41df-bd35-e5c13378b333 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:29.234083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689b3cf-525d-41fa-9b94-70ab79ef0657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:29.234711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b3cf-525d-41fa-9b94-70ab79ef0657 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:29.235071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b3cf-525d-41fa-9b94-70ab79ef0657 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:29.235355 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b3cf-525d-41fa-9b94-70ab79ef0657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:29.236148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689b3cf-525d-41fa-9b94-70ab79ef0657 None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=8a59a4732ec14a838be9c838dbeb7fd0) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:29.236497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689b3cf-525d-41fa-9b94-70ab79ef0657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:29.237978 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689b3cf-525d-41fa-9b94-70ab79ef0657 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:29.245787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 345/697] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:29 2022] GET /identity/v3/role_assignments?user.id=8a59a4732ec14a838be9c838dbeb7fd0&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:29.276464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae4990-c077-49ad-8e21-2fbf19f297c3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:29.279938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:29.461273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae4990-c077-49ad-8e21-2fbf19f297c3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:29.504001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b7ff0-12d4-4698-a580-c1e3d183e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:29.504683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7ff0-12d4-4698-a580-c1e3d183e91c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:29.504962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7ff0-12d4-4698-a580-c1e3d183e91c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:29.505234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7ff0-12d4-4698-a580-c1e3d183e91c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:29.527627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b7ff0-12d4-4698-a580-c1e3d183e91c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-295b7ff0-12d4-4698-a580-c1e3d183e91c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:29.532965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:29.535059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:29.536676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 353/698] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:29.548518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689b3cf-525d-41fa-9b94-70ab79ef0657 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:29.654243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:29.775508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689b3cf-525d-41fa-9b94-70ab79ef0657 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:29.840808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0c159-d4b0-4bb0-ac3f-af9347aa1ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:29.842336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c159-d4b0-4bb0-ac3f-af9347aa1ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:29.843108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c159-d4b0-4bb0-ac3f-af9347aa1ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:29.843871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c159-d4b0-4bb0-ac3f-af9347aa1ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:29.845515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0c159-d4b0-4bb0-ac3f-af9347aa1ad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:29.846315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0c159-d4b0-4bb0-ac3f-af9347aa1ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:29.849427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0c159-d4b0-4bb0-ac3f-af9347aa1ad8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:29.872412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 346/699] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:29.878038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b7ff0-12d4-4698-a580-c1e3d183e91c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:29.974390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:30.024763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b7ff0-12d4-4698-a580-c1e3d183e91c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:30.052381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27121c7d-8115-4a1c-88a1-3e1e335519f7 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:30.053296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27121c7d-8115-4a1c-88a1-3e1e335519f7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:30.054649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27121c7d-8115-4a1c-88a1-3e1e335519f7 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:30.063778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 347/700] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:30.070647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6163da-2c97-43e9-aecc-a9194e9e5453 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:30.071577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6163da-2c97-43e9-aecc-a9194e9e5453 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:30.072373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6163da-2c97-43e9-aecc-a9194e9e5453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:30.074049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8907f8-040c-480e-94d9-51dd71ecab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:30.074709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8907f8-040c-480e-94d9-51dd71ecab6c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:30.075003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8907f8-040c-480e-94d9-51dd71ecab6c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:30.075262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8907f8-040c-480e-94d9-51dd71ecab6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:30.105975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8907f8-040c-480e-94d9-51dd71ecab6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:30.107463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8907f8-040c-480e-94d9-51dd71ecab6c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:30.108926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0c6163da-2c97-43e9-aecc-a9194e9e5453 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:30.110158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0c6163da-2c97-43e9-aecc-a9194e9e5453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-4f8907f8-040c-480e-94d9-51dd71ecab6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:30.138927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:30.141503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:30.143178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:30.143178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:30.143178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:30.143178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 354/701] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:30.154429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8907f8-040c-480e-94d9-51dd71ecab6c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:30.267075 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 348/702] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 11:58:30.371983 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8907f8-040c-480e-94d9-51dd71ecab6c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:30.408647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:30.443212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdac7b-cbf8-4156-bd0b-50bc4574db24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:30.444303 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdac7b-cbf8-4156-bd0b-50bc4574db24 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:30.444797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdac7b-cbf8-4156-bd0b-50bc4574db24 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:30.445266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdac7b-cbf8-4156-bd0b-50bc4574db24 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:30.446436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdac7b-cbf8-4156-bd0b-50bc4574db24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:30.446967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdac7b-cbf8-4156-bd0b-50bc4574db24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:30.449514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdac7b-cbf8-4156-bd0b-50bc4574db24 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:30.479759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 355/703] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:30.485446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6163da-2c97-43e9-aecc-a9194e9e5453 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:30.537087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:30.619915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6163da-2c97-43e9-aecc-a9194e9e5453 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:30.693871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bebec4-3772-4782-922b-dbc5686206d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:30.695469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bebec4-3772-4782-922b-dbc5686206d1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:30.695956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bebec4-3772-4782-922b-dbc5686206d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:30.696464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bebec4-3772-4782-922b-dbc5686206d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:30.718226 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bebec4-3772-4782-922b-dbc5686206d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:30.720997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bebec4-3772-4782-922b-dbc5686206d1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:30.743455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdac7b-cbf8-4156-bd0b-50bc4574db24 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a4bebec4-3772-4782-922b-dbc5686206d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:30.754307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:30.756169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:30.758559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 349/704] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 1 11:58:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:30.763395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bebec4-3772-4782-922b-dbc5686206d1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:30.922832 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:30.939079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bebec4-3772-4782-922b-dbc5686206d1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:30.967022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdac7b-cbf8-4156-bd0b-50bc4574db24 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:31.002475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd1aa1-a5b0-43c6-a891-001915ec6ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:31.003711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1aa1-a5b0-43c6-a891-001915ec6ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:31.004289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1aa1-a5b0-43c6-a891-001915ec6ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:31.004938 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1aa1-a5b0-43c6-a891-001915ec6ed7 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:31.006257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd1aa1-a5b0-43c6-a891-001915ec6ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:31.007438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd1aa1-a5b0-43c6-a891-001915ec6ed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:31.010090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd1aa1-a5b0-43c6-a891-001915ec6ed7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:31.049877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49c380-b1f0-4571-be4d-9d9bbc9c4dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:31.050925 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c380-b1f0-4571-be4d-9d9bbc9c4dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:31.051432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c380-b1f0-4571-be4d-9d9bbc9c4dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:31.051913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c380-b1f0-4571-be4d-9d9bbc9c4dd1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:31.053291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49c380-b1f0-4571-be4d-9d9bbc9c4dd1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:31.053903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 350/705] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 1 11:58:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:31.055887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49c380-b1f0-4571-be4d-9d9bbc9c4dd1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:31.056968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28e3e5-1b35-47e9-a986-2ca50e65d957 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:31.057870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28e3e5-1b35-47e9-a986-2ca50e65d957 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:31.058626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28e3e5-1b35-47e9-a986-2ca50e65d957 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:31.062030 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 351/706] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:31.063919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28e3e5-1b35-47e9-a986-2ca50e65d957 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-fd49c380-b1f0-4571-be4d-9d9bbc9c4dd1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:31.078740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:31.081164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:31.082866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 356/707] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:30 2022] GET /identity/v3/services/network => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:31.084426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16cecd-504a-40e9-924a-19a910ed2be2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:31.084426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16cecd-504a-40e9-924a-19a910ed2be2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:31.084426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16cecd-504a-40e9-924a-19a910ed2be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:31.121817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ae16cecd-504a-40e9-924a-19a910ed2be2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:31.124431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ae16cecd-504a-40e9-924a-19a910ed2be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:31.175063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:31.244530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 357/708] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:31.245839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16cecd-504a-40e9-924a-19a910ed2be2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:31.271543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28e3e5-1b35-47e9-a986-2ca50e65d957 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:31.377162 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d53ccf-2ae5-4762-8319-1758d4ae8303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:31.378323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d53ccf-2ae5-4762-8319-1758d4ae8303 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:31.378848 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d53ccf-2ae5-4762-8319-1758d4ae8303 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:31.379379 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d53ccf-2ae5-4762-8319-1758d4ae8303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:31.432820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:31.499441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16cecd-504a-40e9-924a-19a910ed2be2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:31.552471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d53ccf-2ae5-4762-8319-1758d4ae8303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:31.554624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d53ccf-2ae5-4762-8319-1758d4ae8303 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:31.572427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff78cf-ad34-4b87-9763-b67729938bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:31.575144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff78cf-ad34-4b87-9763-b67729938bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:31.575458 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff78cf-ad34-4b87-9763-b67729938bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:31.575725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff78cf-ad34-4b87-9763-b67729938bb6 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:31.576401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff78cf-ad34-4b87-9763-b67729938bb6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:31.576706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff78cf-ad34-4b87-9763-b67729938bb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:31.578102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff78cf-ad34-4b87-9763-b67729938bb6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:31.587772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 358/709] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:58:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:31.595047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d181e-0798-4554-9fcc-289de75262ed None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:31.595047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d181e-0798-4554-9fcc-289de75262ed None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:31.595047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d181e-0798-4554-9fcc-289de75262ed None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:31.595047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 359/710] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:31.596328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d181e-0798-4554-9fcc-289de75262ed None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:31.632604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:31.753397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d181e-0798-4554-9fcc-289de75262ed None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:31.761179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 352/711] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:31.761179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2533-b9fc-4ff6-a921-e80fcebdb0b1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:31.761179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2533-b9fc-4ff6-a921-e80fcebdb0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:31.761179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2533-b9fc-4ff6-a921-e80fcebdb0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:31.780894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4dbb2533-b9fc-4ff6-a921-e80fcebdb0b1 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:31.782095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4dbb2533-b9fc-4ff6-a921-e80fcebdb0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:31.803859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995a457-5840-4424-93c8-eb5d54c91b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:31.804683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995a457-5840-4424-93c8-eb5d54c91b30 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:31.805083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995a457-5840-4424-93c8-eb5d54c91b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:31.806015 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995a457-5840-4424-93c8-eb5d54c91b30 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:31.806820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995a457-5840-4424-93c8-eb5d54c91b30 None admin] RBAC: Adding query filter params (type=network) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:31.807508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995a457-5840-4424-93c8-eb5d54c91b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:31.809691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995a457-5840-4424-93c8-eb5d54c91b30 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:31.828248 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 360/712] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:58:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:31.828248 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995a457-5840-4424-93c8-eb5d54c91b30 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:31.858258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:31.898757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 353/713] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:31.900581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb2533-b9fc-4ff6-a921-e80fcebdb0b1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:32.078225 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:32.099637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995a457-5840-4424-93c8-eb5d54c91b30 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:32.150815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb2533-b9fc-4ff6-a921-e80fcebdb0b1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:32.182257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6667-d850-42ee-ac58-7aee8fa5868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:32.182939 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6667-d850-42ee-ac58-7aee8fa5868b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:32.183223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6667-d850-42ee-ac58-7aee8fa5868b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:32.183497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6667-d850-42ee-ac58-7aee8fa5868b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:32.184114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6667-d850-42ee-ac58-7aee8fa5868b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:32.185633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6667-d850-42ee-ac58-7aee8fa5868b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-669e6667-d850-42ee-ac58-7aee8fa5868b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:32.209224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:32.211806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:32.213619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 361/714] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Sep 1 11:58:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:32.220185 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6667-d850-42ee-ac58-7aee8fa5868b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:32.247656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb9ac0-efc2-4f5c-b38b-cf196455f144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:32.248425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9ac0-efc2-4f5c-b38b-cf196455f144 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:32.248705 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9ac0-efc2-4f5c-b38b-cf196455f144 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:32.248982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9ac0-efc2-4f5c-b38b-cf196455f144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:32.271392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb9ac0-efc2-4f5c-b38b-cf196455f144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:32.274523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb9ac0-efc2-4f5c-b38b-cf196455f144 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-21eb9ac0-efc2-4f5c-b38b-cf196455f144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:32.308201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:32.310396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:32.313272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:32.313272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:32.313272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:32.313272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 354/715] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:32.324540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb9ac0-efc2-4f5c-b38b-cf196455f144 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:32.405061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:32.430806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6667-d850-42ee-ac58-7aee8fa5868b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:32.481438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bd475-49a4-44c4-b0bc-4b1613444408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:32.482507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bd475-49a4-44c4-b0bc-4b1613444408 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:32.483019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bd475-49a4-44c4-b0bc-4b1613444408 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:32.483504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bd475-49a4-44c4-b0bc-4b1613444408 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:32.484858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bd475-49a4-44c4-b0bc-4b1613444408 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:32.485348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bd475-49a4-44c4-b0bc-4b1613444408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:32.487418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bd475-49a4-44c4-b0bc-4b1613444408 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:32.495608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 362/716] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 1 11:58:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:32.496611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bd475-49a4-44c4-b0bc-4b1613444408 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:32.528198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:32.529380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb9ac0-efc2-4f5c-b38b-cf196455f144 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:32.585351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498fe0-48fd-4fa3-bdd5-7e65643c7971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:32.586380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498fe0-48fd-4fa3-bdd5-7e65643c7971 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:32.586893 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498fe0-48fd-4fa3-bdd5-7e65643c7971 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:32.588284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498fe0-48fd-4fa3-bdd5-7e65643c7971 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:32.588602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c498fe0-48fd-4fa3-bdd5-7e65643c7971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:32.589159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c498fe0-48fd-4fa3-bdd5-7e65643c7971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:32.591589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c498fe0-48fd-4fa3-bdd5-7e65643c7971 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:32.612244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 355/717] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:32.613611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498fe0-48fd-4fa3-bdd5-7e65643c7971 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:32.634176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bd475-49a4-44c4-b0bc-4b1613444408 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:32.679399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158ed5c-f3d2-4a33-bec3-6bca592f8bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:32.679953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ed5c-f3d2-4a33-bec3-6bca592f8bbc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:32.680269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ed5c-f3d2-4a33-bec3-6bca592f8bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:32.680548 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ed5c-f3d2-4a33-bec3-6bca592f8bbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:32.697265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158ed5c-f3d2-4a33-bec3-6bca592f8bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-4158ed5c-f3d2-4a33-bec3-6bca592f8bbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:32.706471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:32.708285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:32.710449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 363/718] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:32.711838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1afd-4137-4b31-a7c7-9bfd3d8fde83 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:32.712089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1afd-4137-4b31-a7c7-9bfd3d8fde83 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:32.712662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1afd-4137-4b31-a7c7-9bfd3d8fde83 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:32.716449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 364/719] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:32.716896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1afd-4137-4b31-a7c7-9bfd3d8fde83 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:32.799553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:32.807645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498fe0-48fd-4fa3-bdd5-7e65643c7971 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:32.853329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170615a-53d9-454f-aa15-1beecee4c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:32.854016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170615a-53d9-454f-aa15-1beecee4c32e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:32.854303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170615a-53d9-454f-aa15-1beecee4c32e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:32.854625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170615a-53d9-454f-aa15-1beecee4c32e None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:32.855236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170615a-53d9-454f-aa15-1beecee4c32e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:32.855543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170615a-53d9-454f-aa15-1beecee4c32e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:32.856979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170615a-53d9-454f-aa15-1beecee4c32e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:32.872248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 356/720] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 1 11:58:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:32.872248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170615a-53d9-454f-aa15-1beecee4c32e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:32.882805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:32.921348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1afd-4137-4b31-a7c7-9bfd3d8fde83 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:33.005287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170615a-53d9-454f-aa15-1beecee4c32e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:33.012512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967f8f8-ace9-41f6-b0fc-8485cc41270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:33.013825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967f8f8-ace9-41f6-b0fc-8485cc41270b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:33.015388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967f8f8-ace9-41f6-b0fc-8485cc41270b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:33.016040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967f8f8-ace9-41f6-b0fc-8485cc41270b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:33.034950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967f8f8-ace9-41f6-b0fc-8485cc41270b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:33.039201 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967f8f8-ace9-41f6-b0fc-8485cc41270b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:33.050245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e64e78-8835-4fcc-91a5-efbbe96d198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:33.050876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64e78-8835-4fcc-91a5-efbbe96d198b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:33.051159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64e78-8835-4fcc-91a5-efbbe96d198b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:33.051437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64e78-8835-4fcc-91a5-efbbe96d198b None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:33.052131 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e64e78-8835-4fcc-91a5-efbbe96d198b None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:33.052472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e64e78-8835-4fcc-91a5-efbbe96d198b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:33.054705 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e64e78-8835-4fcc-91a5-efbbe96d198b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:33.065305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 357/721] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:33.066799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2af4de-55bf-41f2-8315-745080f300e7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:33.067091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2af4de-55bf-41f2-8315-745080f300e7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:33.067372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2af4de-55bf-41f2-8315-745080f300e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6967f8f8-ace9-41f6-b0fc-8485cc41270b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:33.077234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:33.079044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:33.080971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:33.080971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:33.080971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:33.080971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:33.080971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:33.080971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:33.080971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:33.080971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:33.080971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 365/722] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:33.080971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967f8f8-ace9-41f6-b0fc-8485cc41270b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:33.093351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4d2af4de-55bf-41f2-8315-745080f300e7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:33.094771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4d2af4de-55bf-41f2-8315-745080f300e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:33.116411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:33.236344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 358/723] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:33.237467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2af4de-55bf-41f2-8315-745080f300e7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:33.246390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967f8f8-ace9-41f6-b0fc-8485cc41270b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:33.338997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d33d26-bd05-431e-adfd-4e400dfe7d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:33.340168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d33d26-bd05-431e-adfd-4e400dfe7d82 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:33.340794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d33d26-bd05-431e-adfd-4e400dfe7d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:33.341407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d33d26-bd05-431e-adfd-4e400dfe7d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:33.377916 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2af4de-55bf-41f2-8315-745080f300e7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:33.380713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d33d26-bd05-431e-adfd-4e400dfe7d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:33.393941 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d33d26-bd05-431e-adfd-4e400dfe7d82 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:33.399607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e7d33d26-bd05-431e-adfd-4e400dfe7d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:33.430149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:33.431445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:33.432515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:33.432515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:33.432515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:33.432691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a8b93-be4d-4673-af62-f61848103832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:33.432691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a8b93-be4d-4673-af62-f61848103832 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:33.432691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a8b93-be4d-4673-af62-f61848103832 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:33.432951 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a8b93-be4d-4673-af62-f61848103832 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:33.436247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a8b93-be4d-4673-af62-f61848103832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:33.436247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a8b93-be4d-4673-af62-f61848103832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:33.436247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a8b93-be4d-4673-af62-f61848103832 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:33.437906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 366/724] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:33.446297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d33d26-bd05-431e-adfd-4e400dfe7d82 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:33.467592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 359/725] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:33.472646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a8b93-be4d-4673-af62-f61848103832 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:33.496644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:33.623233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a8b93-be4d-4673-af62-f61848103832 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:33.629816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d33d26-bd05-431e-adfd-4e400dfe7d82 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:33.662968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f164a6-347a-46be-aa65-4d9f662ac5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:33.663593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f164a6-347a-46be-aa65-4d9f662ac5fd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:33.663876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f164a6-347a-46be-aa65-4d9f662ac5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:33.664155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f164a6-347a-46be-aa65-4d9f662ac5fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:33.664966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f164a6-347a-46be-aa65-4d9f662ac5fd None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=7790d6ec0e524ee6a31fd06fda9c4ac7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:33.665277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f164a6-347a-46be-aa65-4d9f662ac5fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:33.666720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f164a6-347a-46be-aa65-4d9f662ac5fd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:33.673825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 360/726] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:33 2022] GET /identity/v3/role_assignments?user.id=7790d6ec0e524ee6a31fd06fda9c4ac7&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:33.704391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f164a6-347a-46be-aa65-4d9f662ac5fd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:33.717692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea327685-dcaf-4018-8d6f-e340e1cfac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:33.721383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea327685-dcaf-4018-8d6f-e340e1cfac87 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:33.721693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea327685-dcaf-4018-8d6f-e340e1cfac87 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:33.721972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea327685-dcaf-4018-8d6f-e340e1cfac87 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:33.722689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea327685-dcaf-4018-8d6f-e340e1cfac87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:33.722995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea327685-dcaf-4018-8d6f-e340e1cfac87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:33.728616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea327685-dcaf-4018-8d6f-e340e1cfac87 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:33.750559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 367/727] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:33.762336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea327685-dcaf-4018-8d6f-e340e1cfac87 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:33.875502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:33.888728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:33.912582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f164a6-347a-46be-aa65-4d9f662ac5fd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:33.969293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea327685-dcaf-4018-8d6f-e340e1cfac87 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:33.996288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d342e9e-9580-4901-8acb-649a45404ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:33.997311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d342e9e-9580-4901-8acb-649a45404ade None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:33.998458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d342e9e-9580-4901-8acb-649a45404ade None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:33.998990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d342e9e-9580-4901-8acb-649a45404ade None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:34.024249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d342e9e-9580-4901-8acb-649a45404ade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-1d342e9e-9580-4901-8acb-649a45404ade None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:34.038566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:34.039581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:34.040438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:34.045112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 361/728] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:34.052249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d342e9e-9580-4901-8acb-649a45404ade None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:34.061064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7116d-8e1a-4ea8-acf1-ae59abf7ca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:34.062018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7116d-8e1a-4ea8-acf1-ae59abf7ca74 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:34.062448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7116d-8e1a-4ea8-acf1-ae59abf7ca74 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:34.062867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7116d-8e1a-4ea8-acf1-ae59abf7ca74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:34.071630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7116d-8e1a-4ea8-acf1-ae59abf7ca74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:34.080243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7116d-8e1a-4ea8-acf1-ae59abf7ca74 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-09c7116d-8e1a-4ea8-acf1-ae59abf7ca74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:34.103783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:34.105736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:34.106686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:34.106686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:34.106686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:34.106686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:34.106686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:34.106686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:34.106686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:34.106686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:34.106686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:58:34.106686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:34.109596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 368/729] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 1 11:58:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:34.116402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7116d-8e1a-4ea8-acf1-ae59abf7ca74 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:34.231698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d342e9e-9580-4901-8acb-649a45404ade None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:34.253913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7116d-8e1a-4ea8-acf1-ae59abf7ca74 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:34.270593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eb069-fc98-4dce-978c-3c4146424a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:34.271222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eb069-fc98-4dce-978c-3c4146424a5c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:34.271504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eb069-fc98-4dce-978c-3c4146424a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:34.271776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eb069-fc98-4dce-978c-3c4146424a5c None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:34.273165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46eb069-fc98-4dce-978c-3c4146424a5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:34.273479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46eb069-fc98-4dce-978c-3c4146424a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:34.274911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46eb069-fc98-4dce-978c-3c4146424a5c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:34.276638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:34.277540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:34.285205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 362/730] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:34.286538 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fedd82-2ea2-4668-8d9c-0d8ddb746501 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:34.286817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fedd82-2ea2-4668-8d9c-0d8ddb746501 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:34.287088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fedd82-2ea2-4668-8d9c-0d8ddb746501 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:34.292939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 363/731] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:34.294497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fedd82-2ea2-4668-8d9c-0d8ddb746501 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:34.300553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b462912-1ded-441c-989f-5c6c07731d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:34.302229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462912-1ded-441c-989f-5c6c07731d5f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:34.302516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462912-1ded-441c-989f-5c6c07731d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:34.302794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462912-1ded-441c-989f-5c6c07731d5f None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:34.303596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b462912-1ded-441c-989f-5c6c07731d5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:34.304943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b462912-1ded-441c-989f-5c6c07731d5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:34.305391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b462912-1ded-441c-989f-5c6c07731d5f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:34.332688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 369/732] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 1 11:58:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:34.335098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3eb645-0618-4874-8b09-3a138fd86350 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:34.335463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3eb645-0618-4874-8b09-3a138fd86350 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:34.336041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3eb645-0618-4874-8b09-3a138fd86350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:34.364485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5a3eb645-0618-4874-8b09-3a138fd86350 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:34.366301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5a3eb645-0618-4874-8b09-3a138fd86350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:34.434390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fedd82-2ea2-4668-8d9c-0d8ddb746501 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:34.465992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 370/733] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:34.467044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3eb645-0618-4874-8b09-3a138fd86350 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:34.505156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacfdca-4999-4c8c-97b4-9dc06a01f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:34.505843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacfdca-4999-4c8c-97b4-9dc06a01f4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:34.506815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacfdca-4999-4c8c-97b4-9dc06a01f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:34.507186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacfdca-4999-4c8c-97b4-9dc06a01f4c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:34.540670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacfdca-4999-4c8c-97b4-9dc06a01f4c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:34.542161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacfdca-4999-4c8c-97b4-9dc06a01f4c2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7bacfdca-4999-4c8c-97b4-9dc06a01f4c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:34.581792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:34.582805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:34.583675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:34.583675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:34.583675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:34.590468 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3eb645-0618-4874-8b09-3a138fd86350 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:34.592660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 364/734] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:34.593147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:34.594469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacfdca-4999-4c8c-97b4-9dc06a01f4c2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:34.633950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b15ff-e2e7-4e7b-b97e-fd47ce27f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:34.635464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b15ff-e2e7-4e7b-b97e-fd47ce27f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:34.635898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b15ff-e2e7-4e7b-b97e-fd47ce27f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:34.636673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b15ff-e2e7-4e7b-b97e-fd47ce27f1f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:34.693502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:34.749229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b15ff-e2e7-4e7b-b97e-fd47ce27f1f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:34.750697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b15ff-e2e7-4e7b-b97e-fd47ce27f1f1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:34.751945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacfdca-4999-4c8c-97b4-9dc06a01f4c2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:34.793913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8517022-b6ad-45ea-b249-6508a0e40f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:34.794495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8517022-b6ad-45ea-b249-6508a0e40f57 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:34.794779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8517022-b6ad-45ea-b249-6508a0e40f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:34.795058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8517022-b6ad-45ea-b249-6508a0e40f57 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:34.795981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8517022-b6ad-45ea-b249-6508a0e40f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:34.796325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8517022-b6ad-45ea-b249-6508a0e40f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:34.797728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8517022-b6ad-45ea-b249-6508a0e40f57 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:34.812934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 365/735] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:34.819741 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8517022-b6ad-45ea-b249-6508a0e40f57 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:34.899482 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 371/736] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:34.901058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b15ff-e2e7-4e7b-b97e-fd47ce27f1f1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:34.920861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:34.984633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8517022-b6ad-45ea-b249-6508a0e40f57 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:34.996387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:35.028095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b15ff-e2e7-4e7b-b97e-fd47ce27f1f1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:35.028458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcaac92-9b5a-45b9-8638-cd0f9144c86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:35.029114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaac92-9b5a-45b9-8638-cd0f9144c86c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:35.029396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaac92-9b5a-45b9-8638-cd0f9144c86c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:35.029675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaac92-9b5a-45b9-8638-cd0f9144c86c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:35.041874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcaac92-9b5a-45b9-8638-cd0f9144c86c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:35.044101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcaac92-9b5a-45b9-8638-cd0f9144c86c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9dcaac92-9b5a-45b9-8638-cd0f9144c86c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:35.067898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:35.068985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:35.069931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:35.069931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:35.069931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:35.069931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:35.069931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:35.069931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:35.069931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:35.069931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:35.069931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:35.069931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:35.072355 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 366/737] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:35.073465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcaac92-9b5a-45b9-8638-cd0f9144c86c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:35.082765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0ab25-937b-44ff-89e0-7526269e5d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:35.083736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0ab25-937b-44ff-89e0-7526269e5d4e None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:35.084246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0ab25-937b-44ff-89e0-7526269e5d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:35.084768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0ab25-937b-44ff-89e0-7526269e5d4e None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:35.085661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0ab25-937b-44ff-89e0-7526269e5d4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:35.087244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0ab25-937b-44ff-89e0-7526269e5d4e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:35.197640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcaac92-9b5a-45b9-8638-cd0f9144c86c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:35.204439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 372/738] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:58:34 2022] POST /identity/v3/services => generated 240 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 11:58:35.207148 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0ab25-937b-44ff-89e0-7526269e5d4e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:35.276823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426616b-14dc-4e6a-b213-3e8f07a669d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:35.277487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426616b-14dc-4e6a-b213-3e8f07a669d8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:35.277771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426616b-14dc-4e6a-b213-3e8f07a669d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:35.278043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426616b-14dc-4e6a-b213-3e8f07a669d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:35.292337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426616b-14dc-4e6a-b213-3e8f07a669d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:35.293991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426616b-14dc-4e6a-b213-3e8f07a669d8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f426616b-14dc-4e6a-b213-3e8f07a669d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:35.325449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:35.327524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:35.329434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:35.329434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:35.329434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:35.330942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 367/739] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:35.331399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0e62-f606-4a52-8793-e6e261a814cc None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:35.331683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0e62-f606-4a52-8793-e6e261a814cc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:35.331967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0e62-f606-4a52-8793-e6e261a814cc None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:35.333748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 368/740] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:35.335198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e0e62-f606-4a52-8793-e6e261a814cc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:35.360381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:35.363094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:35.423658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0ab25-937b-44ff-89e0-7526269e5d4e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:35.487649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282364c0-35e8-4050-bb2a-cc8839979412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:35.488749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282364c0-35e8-4050-bb2a-cc8839979412 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:35.489511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282364c0-35e8-4050-bb2a-cc8839979412 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:35.490095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282364c0-35e8-4050-bb2a-cc8839979412 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:35.492025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282364c0-35e8-4050-bb2a-cc8839979412 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:35.492655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282364c0-35e8-4050-bb2a-cc8839979412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:35.496867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282364c0-35e8-4050-bb2a-cc8839979412 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:35.538164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 373/741] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 1 11:58:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:35.542290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf981775-d79c-42cb-aeca-4966a2114b9a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:35.543089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf981775-d79c-42cb-aeca-4966a2114b9a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:35.543779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf981775-d79c-42cb-aeca-4966a2114b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:35.545067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e0e62-f606-4a52-8793-e6e261a814cc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:35.586644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3803b-2064-47b4-bb0d-6bd4f55aa697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:35.587163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3803b-2064-47b4-bb0d-6bd4f55aa697 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:35.587441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3803b-2064-47b4-bb0d-6bd4f55aa697 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:35.587720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3803b-2064-47b4-bb0d-6bd4f55aa697 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:35.588472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3803b-2064-47b4-bb0d-6bd4f55aa697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:35.588782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3803b-2064-47b4-bb0d-6bd4f55aa697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:35.589040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-cf981775-d79c-42cb-aeca-4966a2114b9a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:35.590186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3803b-2064-47b4-bb0d-6bd4f55aa697 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:35.592235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cf981775-d79c-42cb-aeca-4966a2114b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:35.606172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 369/742] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:35.607211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3803b-2064-47b4-bb0d-6bd4f55aa697 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:35.713077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:35.747218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 374/743] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:35 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 11:58:35.748167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf981775-d79c-42cb-aeca-4966a2114b9a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:35.764135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3803b-2064-47b4-bb0d-6bd4f55aa697 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:35.837960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eb671-e68e-41fc-9712-db0a7934a26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:35.839500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eb671-e68e-41fc-9712-db0a7934a26e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:35.840322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eb671-e68e-41fc-9712-db0a7934a26e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:35.841074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eb671-e68e-41fc-9712-db0a7934a26e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:35.857275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:35.921382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf981775-d79c-42cb-aeca-4966a2114b9a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:35.954953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6eb671-e68e-41fc-9712-db0a7934a26e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:35.956712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6eb671-e68e-41fc-9712-db0a7934a26e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:35.994002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa368bb4-2798-4001-9f70-2751a850adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:35.995834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368bb4-2798-4001-9f70-2751a850adae None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:35.996769 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368bb4-2798-4001-9f70-2751a850adae None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:35.997555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368bb4-2798-4001-9f70-2751a850adae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:36.011377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368bb4-2798-4001-9f70-2751a850adae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:36.014966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368bb4-2798-4001-9f70-2751a850adae None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-aa368bb4-2798-4001-9f70-2751a850adae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:36.041531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:36.043256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:36.045024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:36.045024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:36.045024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:36.045024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:36.045024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:36.045024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:36.045024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:36.045024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:36.048956 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 375/744] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:36.049411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:36.051882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37f9a-720d-4cb6-8cce-c01d089e9570 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:36.053082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37f9a-720d-4cb6-8cce-c01d089e9570 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:36.053834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37f9a-720d-4cb6-8cce-c01d089e9570 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:36.056758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 376/745] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:36.058382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37f9a-720d-4cb6-8cce-c01d089e9570 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:36.076578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 370/746] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:35 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 11:58:36.077563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eb671-e68e-41fc-9712-db0a7934a26e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:36.196924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37f9a-720d-4cb6-8cce-c01d089e9570 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:36.215277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eb671-e68e-41fc-9712-db0a7934a26e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:36.220504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:36.254358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6d43d-1d87-45b1-9f8b-4895492bf176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:36.254979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6d43d-1d87-45b1-9f8b-4895492bf176 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:36.255261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6d43d-1d87-45b1-9f8b-4895492bf176 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:36.255556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6d43d-1d87-45b1-9f8b-4895492bf176 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:36.256811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6d43d-1d87-45b1-9f8b-4895492bf176 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:36.257139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6d43d-1d87-45b1-9f8b-4895492bf176 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:36.258573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6d43d-1d87-45b1-9f8b-4895492bf176 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:36.260927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238771c6-9e8b-4353-9d63-b304c4e9f671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:36.261924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238771c6-9e8b-4353-9d63-b304c4e9f671 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:36.262392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238771c6-9e8b-4353-9d63-b304c4e9f671 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:36.262852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238771c6-9e8b-4353-9d63-b304c4e9f671 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:36.264004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238771c6-9e8b-4353-9d63-b304c4e9f671 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:36.266580 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238771c6-9e8b-4353-9d63-b304c4e9f671 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:36.276754 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 371/747] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:36.276754 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba38cf-103f-442d-a5b4-ddeffb004057 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:36.276754 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba38cf-103f-442d-a5b4-ddeffb004057 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:36.276754 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba38cf-103f-442d-a5b4-ddeffb004057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:36.293888 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0cba38cf-103f-442d-a5b4-ddeffb004057 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:36.295124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0cba38cf-103f-442d-a5b4-ddeffb004057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:36.329526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:36.350700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 377/748] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:58:36 2022] POST /identity/v3/services => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:58:36.351601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238771c6-9e8b-4353-9d63-b304c4e9f671 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:36.412308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 372/749] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:36.414699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba38cf-103f-442d-a5b4-ddeffb004057 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:36.502451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238771c6-9e8b-4353-9d63-b304c4e9f671 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:36.599615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354316c6-c489-4b8f-845a-4eeb7d1129f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:36.600393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354316c6-c489-4b8f-845a-4eeb7d1129f0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:36.600669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354316c6-c489-4b8f-845a-4eeb7d1129f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:36.600951 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354316c6-c489-4b8f-845a-4eeb7d1129f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:36.618293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354316c6-c489-4b8f-845a-4eeb7d1129f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:36.620050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354316c6-c489-4b8f-845a-4eeb7d1129f0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-354316c6-c489-4b8f-845a-4eeb7d1129f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:36.638212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:36.639576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:36.641336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:36.641336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:36.641336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:36.641336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 378/750] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:36.654786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354316c6-c489-4b8f-845a-4eeb7d1129f0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:36.666621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba38cf-103f-442d-a5b4-ddeffb004057 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:36.694097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:36.753795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cda9c-0258-4da2-83e0-8b67a575b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:36.755926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cda9c-0258-4da2-83e0-8b67a575b545 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:36.756969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cda9c-0258-4da2-83e0-8b67a575b545 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:36.757472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cda9c-0258-4da2-83e0-8b67a575b545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:36.758932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cda9c-0258-4da2-83e0-8b67a575b545 None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=9b9457f6eebd49e7858158a1706ec99d) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:36.759503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cda9c-0258-4da2-83e0-8b67a575b545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:36.761483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cda9c-0258-4da2-83e0-8b67a575b545 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:36.770134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 373/751] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:36 2022] GET /identity/v3/role_assignments?user.id=9b9457f6eebd49e7858158a1706ec99d&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 259 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:36.775503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cda9c-0258-4da2-83e0-8b67a575b545 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:36.811430 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354316c6-c489-4b8f-845a-4eeb7d1129f0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:36.851948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:36.853706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7e6a0-ece6-45af-ae01-cffb2f9ce875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:36.854353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e6a0-ece6-45af-ae01-cffb2f9ce875 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:36.854645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e6a0-ece6-45af-ae01-cffb2f9ce875 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:36.854924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e6a0-ece6-45af-ae01-cffb2f9ce875 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:36.855614 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7e6a0-ece6-45af-ae01-cffb2f9ce875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:36.855923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7e6a0-ece6-45af-ae01-cffb2f9ce875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:36.858048 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7e6a0-ece6-45af-ae01-cffb2f9ce875 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:36.879965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 379/752] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:36.882789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7e6a0-ece6-45af-ae01-cffb2f9ce875 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:37.002571 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:37.008389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cda9c-0258-4da2-83e0-8b67a575b545 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:37.024258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7e6a0-ece6-45af-ae01-cffb2f9ce875 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:37.105922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c10e7e-b93f-4649-9b7e-70fd02a8a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:37.107654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c10e7e-b93f-4649-9b7e-70fd02a8a543 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:37.108945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c10e7e-b93f-4649-9b7e-70fd02a8a543 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:37.111197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c10e7e-b93f-4649-9b7e-70fd02a8a543 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:37.138196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c10e7e-b93f-4649-9b7e-70fd02a8a543 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:37.143261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c10e7e-b93f-4649-9b7e-70fd02a8a543 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:37.145017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90c219-4277-4e88-a69e-615256f79cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:37.146576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90c219-4277-4e88-a69e-615256f79cea None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:37.148068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90c219-4277-4e88-a69e-615256f79cea None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:37.148904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90c219-4277-4e88-a69e-615256f79cea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-d2c10e7e-b93f-4649-9b7e-70fd02a8a543 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:37.167486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:37.169327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:37.171376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:37.171376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:37.171376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:37.171376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:37.171376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:37.171376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:37.171376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:37.171376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:37.176780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90c219-4277-4e88-a69e-615256f79cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:37.177154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 380/753] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:37.183403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c10e7e-b93f-4649-9b7e-70fd02a8a543 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-fd90c219-4277-4e88-a69e-615256f79cea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:37.196821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:37.198722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:37.200455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:37.204331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 374/754] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:37.212769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90c219-4277-4e88-a69e-615256f79cea None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:37.379995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c10e7e-b93f-4649-9b7e-70fd02a8a543 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:37.416254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae590bb-ed58-49e8-901d-419256532e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:37.416254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae590bb-ed58-49e8-901d-419256532e19 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:37.416254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae590bb-ed58-49e8-901d-419256532e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:37.416254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae590bb-ed58-49e8-901d-419256532e19 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:37.416903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae590bb-ed58-49e8-901d-419256532e19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:37.416903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae590bb-ed58-49e8-901d-419256532e19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:37.416903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae590bb-ed58-49e8-901d-419256532e19 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:37.435031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 381/755] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:37.436432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae590bb-ed58-49e8-901d-419256532e19 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:37.440638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:37.531276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:37.558833 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae590bb-ed58-49e8-901d-419256532e19 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:37.592642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90c219-4277-4e88-a69e-615256f79cea None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:37.599836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910fa6d-f49c-4f86-ab4a-51c57882ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:37.601024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910fa6d-f49c-4f86-ab4a-51c57882ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:37.601303 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910fa6d-f49c-4f86-ab4a-51c57882ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:37.601572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910fa6d-f49c-4f86-ab4a-51c57882ffc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:37.603034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910fa6d-f49c-4f86-ab4a-51c57882ffc4 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=8a59a4732ec14a838be9c838dbeb7fd0) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:37.603034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910fa6d-f49c-4f86-ab4a-51c57882ffc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:37.604172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910fa6d-f49c-4f86-ab4a-51c57882ffc4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:37.616412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 382/756] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:37 2022] GET /identity/v3/role_assignments?user.id=8a59a4732ec14a838be9c838dbeb7fd0&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:37.708725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f76bd-4a44-47fd-9904-f0a81d3cb580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:37.710701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f76bd-4a44-47fd-9904-f0a81d3cb580 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:37.711196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f76bd-4a44-47fd-9904-f0a81d3cb580 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:37.711679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f76bd-4a44-47fd-9904-f0a81d3cb580 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:37.712629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f76bd-4a44-47fd-9904-f0a81d3cb580 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:37.713151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f76bd-4a44-47fd-9904-f0a81d3cb580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:37.714821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f76bd-4a44-47fd-9904-f0a81d3cb580 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:37.730779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 375/757] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:37.740246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910fa6d-f49c-4f86-ab4a-51c57882ffc4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:37.847049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:37.893879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910fa6d-f49c-4f86-ab4a-51c57882ffc4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:37.937276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb202f-910c-4e61-ac79-f207e7683a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:37.938262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb202f-910c-4e61-ac79-f207e7683a48 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:37.938755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb202f-910c-4e61-ac79-f207e7683a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:37.939229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb202f-910c-4e61-ac79-f207e7683a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:37.969966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb202f-910c-4e61-ac79-f207e7683a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:37.972699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb202f-910c-4e61-ac79-f207e7683a48 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-afbb202f-910c-4e61-ac79-f207e7683a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:38.003616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:38.004648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:38.005539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:38.005539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:38.005539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:38.006677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 383/758] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:38.012241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f76bd-4a44-47fd-9904-f0a81d3cb580 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:38.125314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe5758-2aa1-45d5-bbff-532d6eb75f20 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:38.125997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe5758-2aa1-45d5-bbff-532d6eb75f20 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:38.126595 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe5758-2aa1-45d5-bbff-532d6eb75f20 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:38.129497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 384/759] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:38.138944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfec29-e492-420a-b1e1-eab10305df79 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:38.139563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfec29-e492-420a-b1e1-eab10305df79 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:38.140109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfec29-e492-420a-b1e1-eab10305df79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:38.167980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-74dfec29-e492-420a-b1e1-eab10305df79 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:38.170178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-74dfec29-e492-420a-b1e1-eab10305df79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:38.255870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f76bd-4a44-47fd-9904-f0a81d3cb580 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:38.371525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d525d0-4d55-4b6a-863b-7a0c56d80959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:38.372170 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d525d0-4d55-4b6a-863b-7a0c56d80959 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:38.372563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d525d0-4d55-4b6a-863b-7a0c56d80959 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:38.372840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d525d0-4d55-4b6a-863b-7a0c56d80959 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:38.373510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d525d0-4d55-4b6a-863b-7a0c56d80959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:38.373819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d525d0-4d55-4b6a-863b-7a0c56d80959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:38.375212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d525d0-4d55-4b6a-863b-7a0c56d80959 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:38.395937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 376/760] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:38.403009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 385/761] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:58:38.403996 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d525d0-4d55-4b6a-863b-7a0c56d80959 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:38.434491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:38.626308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d525d0-4d55-4b6a-863b-7a0c56d80959 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:38.721396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619656c1-144d-43f7-a9ed-8b8ac5603702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:38.722565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619656c1-144d-43f7-a9ed-8b8ac5603702 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:38.722908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619656c1-144d-43f7-a9ed-8b8ac5603702 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:38.723400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619656c1-144d-43f7-a9ed-8b8ac5603702 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:38.742528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619656c1-144d-43f7-a9ed-8b8ac5603702 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:38.745072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619656c1-144d-43f7-a9ed-8b8ac5603702 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-619656c1-144d-43f7-a9ed-8b8ac5603702 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:38.779124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:38.781653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:38.783680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 377/762] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 1 11:58:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:38.788140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfec29-e492-420a-b1e1-eab10305df79 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:38.861386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619656c1-144d-43f7-a9ed-8b8ac5603702 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:38.889073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:39.006950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfec29-e492-420a-b1e1-eab10305df79 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:39.030080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:39.047096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8839b-f744-435f-8875-546925d95cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:39.047745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8839b-f744-435f-8875-546925d95cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:39.048558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8839b-f744-435f-8875-546925d95cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:39.048558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8839b-f744-435f-8875-546925d95cb3 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:39.049146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8839b-f744-435f-8875-546925d95cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:39.049461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8839b-f744-435f-8875-546925d95cb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:39.051081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8839b-f744-435f-8875-546925d95cb3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:39.074383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 386/763] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 1 11:58:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:39.082239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8839b-f744-435f-8875-546925d95cb3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:39.101357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619656c1-144d-43f7-a9ed-8b8ac5603702 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:39.178946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086362-125c-4b95-b5d3-d06184ba6062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:39.179625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086362-125c-4b95-b5d3-d06184ba6062 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:39.179911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086362-125c-4b95-b5d3-d06184ba6062 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:39.180190 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086362-125c-4b95-b5d3-d06184ba6062 None admin] PATH_INFO: `/v3/services/network` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:39.180875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36086362-125c-4b95-b5d3-d06184ba6062 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:39.182329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36086362-125c-4b95-b5d3-d06184ba6062 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-36086362-125c-4b95-b5d3-d06184ba6062 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:39.212948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:39.214815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:39.217345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 378/764] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:38 2022] GET /identity/v3/services/network => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:39.224752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086362-125c-4b95-b5d3-d06184ba6062 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:39.286883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8839b-f744-435f-8875-546925d95cb3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:39.298775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:39.335015 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7a1a6-4e08-47d1-9a0e-81eec2b7b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:39.335657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7a1a6-4e08-47d1-9a0e-81eec2b7b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:39.335935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7a1a6-4e08-47d1-9a0e-81eec2b7b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:39.336242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7a1a6-4e08-47d1-9a0e-81eec2b7b1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:39.352541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7a1a6-4e08-47d1-9a0e-81eec2b7b1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:39.354029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7a1a6-4e08-47d1-9a0e-81eec2b7b1a8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-bbc7a1a6-4e08-47d1-9a0e-81eec2b7b1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:39.371561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:39.373386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:39.375239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:39.375239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:39.375239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:39.375239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 387/765] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:39.375239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d336bee-76c9-4bf6-9431-c88bb57b5c43 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:39.375239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d336bee-76c9-4bf6-9431-c88bb57b5c43 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:39.375239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d336bee-76c9-4bf6-9431-c88bb57b5c43 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:39.382439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 388/766] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:39.382439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d336bee-76c9-4bf6-9431-c88bb57b5c43 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:39.478597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086362-125c-4b95-b5d3-d06184ba6062 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:39.521127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d336bee-76c9-4bf6-9431-c88bb57b5c43 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:39.560556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:39.569522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184d651-7249-4c93-929a-d3f4a9c78cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:39.570154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d651-7249-4c93-929a-d3f4a9c78cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:39.570434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d651-7249-4c93-929a-d3f4a9c78cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:39.570716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d651-7249-4c93-929a-d3f4a9c78cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:39.571436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184d651-7249-4c93-929a-d3f4a9c78cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:39.571749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184d651-7249-4c93-929a-d3f4a9c78cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:39.573166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184d651-7249-4c93-929a-d3f4a9c78cb0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:39.575226 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e95e3-28cf-478e-9954-1e317556b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:39.577532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e95e3-28cf-478e-9954-1e317556b49e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:39.580879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e95e3-28cf-478e-9954-1e317556b49e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:39.580879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e95e3-28cf-478e-9954-1e317556b49e None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:39.580879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e95e3-28cf-478e-9954-1e317556b49e None admin] RBAC: Adding query filter params (name=network) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:39.580879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e95e3-28cf-478e-9954-1e317556b49e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:39.585503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e95e3-28cf-478e-9954-1e317556b49e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:39.596286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 389/767] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:39.596286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec72323-9fc4-4d57-90c2-46f4ae30847d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:39.596286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec72323-9fc4-4d57-90c2-46f4ae30847d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:39.596286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec72323-9fc4-4d57-90c2-46f4ae30847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:39.599459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 379/768] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:58:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:39.602964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e95e3-28cf-478e-9954-1e317556b49e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:39.617838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1ec72323-9fc4-4d57-90c2-46f4ae30847d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:39.619122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1ec72323-9fc4-4d57-90c2-46f4ae30847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:39.640274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:39.744476 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 390/769] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:39.745447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec72323-9fc4-4d57-90c2-46f4ae30847d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:39.859748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e95e3-28cf-478e-9954-1e317556b49e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:39.885014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec72323-9fc4-4d57-90c2-46f4ae30847d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:39.930345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fff4c-a918-4999-a500-6572d033ee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:39.931334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fff4c-a918-4999-a500-6572d033ee2e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:39.931334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fff4c-a918-4999-a500-6572d033ee2e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:39.931617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fff4c-a918-4999-a500-6572d033ee2e None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:39.932326 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fff4c-a918-4999-a500-6572d033ee2e None admin] RBAC: Adding query filter params (type=network) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:39.932695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fff4c-a918-4999-a500-6572d033ee2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:39.934195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fff4c-a918-4999-a500-6572d033ee2e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:39.941745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 391/770] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:58:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:39.943348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf259964-fe44-46a3-bb00-1826503c9a9b None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:39.944269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf259964-fe44-46a3-bb00-1826503c9a9b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:39.944619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf259964-fe44-46a3-bb00-1826503c9a9b None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:39.947078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc25db-c313-4e61-8e9a-71c1c913268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:39.948550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc25db-c313-4e61-8e9a-71c1c913268a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:39.949265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc25db-c313-4e61-8e9a-71c1c913268a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:39.949962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc25db-c313-4e61-8e9a-71c1c913268a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:39.950526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 392/771] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:39.951672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf259964-fe44-46a3-bb00-1826503c9a9b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:39.970740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc25db-c313-4e61-8e9a-71c1c913268a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:39.971018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:39.975421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc25db-c313-4e61-8e9a-71c1c913268a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-48cc25db-c313-4e61-8e9a-71c1c913268a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:40.003598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:40.005590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:40.007877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:40.007877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:40.007877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:40.007877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:40.007877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:40.007877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:40.007877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:40.007877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:40.007877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 380/772] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:40.016937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0fc0-d9cf-48bb-a64b-314057442135 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:40.016937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0fc0-d9cf-48bb-a64b-314057442135 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:40.016937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0fc0-d9cf-48bb-a64b-314057442135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:40.036738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f81c0fc0-d9cf-48bb-a64b-314057442135 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:40.038623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f81c0fc0-d9cf-48bb-a64b-314057442135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:40.097766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf259964-fe44-46a3-bb00-1826503c9a9b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:40.109600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:40.130853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 381/773] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:40.132557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c0fc0-d9cf-48bb-a64b-314057442135 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:40.167398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86aa5-4af9-4239-80ae-c177f84eb20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:40.169745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86aa5-4af9-4239-80ae-c177f84eb20e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:40.170749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86aa5-4af9-4239-80ae-c177f84eb20e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:40.171722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86aa5-4af9-4239-80ae-c177f84eb20e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:40.174498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86aa5-4af9-4239-80ae-c177f84eb20e None admin] RBAC: Adding query filter params (interface=public, service_id=15a2b7f77ed841cf8f8c57cfdc1f40d2, region_id=RegionOne) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:40.175330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86aa5-4af9-4239-80ae-c177f84eb20e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:40.178714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86aa5-4af9-4239-80ae-c177f84eb20e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:40.207096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 393/774] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 1 11:58:39 2022] GET /identity/v3/endpoints?service_id=15a2b7f77ed841cf8f8c57cfdc1f40d2&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:40.209351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86aa5-4af9-4239-80ae-c177f84eb20e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:40.260810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c0fc0-d9cf-48bb-a64b-314057442135 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:40.319335 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f9800-1cda-4d20-8620-12ffafca97c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:40.320338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f9800-1cda-4d20-8620-12ffafca97c0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:40.320810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f9800-1cda-4d20-8620-12ffafca97c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:40.321727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f9800-1cda-4d20-8620-12ffafca97c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:40.322932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f9800-1cda-4d20-8620-12ffafca97c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:40.323461 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f9800-1cda-4d20-8620-12ffafca97c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:40.325753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f9800-1cda-4d20-8620-12ffafca97c0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:40.328631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:40.350206 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 382/775] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:40.350206 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f9800-1cda-4d20-8620-12ffafca97c0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:40.372547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86aa5-4af9-4239-80ae-c177f84eb20e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:40.401592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:40.424892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aac78d-2924-46f1-8a3a-ecd4b78192c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:40.425535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aac78d-2924-46f1-8a3a-ecd4b78192c4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:40.425809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aac78d-2924-46f1-8a3a-ecd4b78192c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:40.426079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aac78d-2924-46f1-8a3a-ecd4b78192c4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:40.426674 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aac78d-2924-46f1-8a3a-ecd4b78192c4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:40.428107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aac78d-2924-46f1-8a3a-ecd4b78192c4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e7aac78d-2924-46f1-8a3a-ecd4b78192c4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:40.438752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:40.440576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:40.441465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 394/776] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Sep 1 11:58:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:40.442408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fec8ca-b101-405b-adfd-0999bf6db572 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:40.442408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fec8ca-b101-405b-adfd-0999bf6db572 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:40.442408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fec8ca-b101-405b-adfd-0999bf6db572 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:40.447763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 395/777] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:40.448651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fec8ca-b101-405b-adfd-0999bf6db572 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:40.466822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f9800-1cda-4d20-8620-12ffafca97c0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:40.502023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05268ab4-b95a-4f45-a21a-faef101893ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:40.502644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05268ab4-b95a-4f45-a21a-faef101893ac None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:40.502925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05268ab4-b95a-4f45-a21a-faef101893ac None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:40.503205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05268ab4-b95a-4f45-a21a-faef101893ac None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:40.503827 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05268ab4-b95a-4f45-a21a-faef101893ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:40.505241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05268ab4-b95a-4f45-a21a-faef101893ac None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:40.511437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 383/778] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 1 11:58:40 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:40.512001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05268ab4-b95a-4f45-a21a-faef101893ac None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:40.623151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fec8ca-b101-405b-adfd-0999bf6db572 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:40.677781 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05268ab4-b95a-4f45-a21a-faef101893ac None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:40.691260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:40.697622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d6069-185f-4e9a-9f7d-1df53672eb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:40.698588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6069-185f-4e9a-9f7d-1df53672eb48 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:40.698880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6069-185f-4e9a-9f7d-1df53672eb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:40.699135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6069-185f-4e9a-9f7d-1df53672eb48 None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/7790d6ec0e524ee6a31fd06fda9c4ac7/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:40.704277 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d6069-185f-4e9a-9f7d-1df53672eb48 None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=7790d6ec0e524ee6a31fd06fda9c4ac7, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:40.704277 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d6069-185f-4e9a-9f7d-1df53672eb48 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:40.736562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f5bef-0f8c-4c6d-b62c-a1f7f2b2196d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:40.737622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f5bef-0f8c-4c6d-b62c-a1f7f2b2196d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:40.738154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f5bef-0f8c-4c6d-b62c-a1f7f2b2196d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:40.738573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f5bef-0f8c-4c6d-b62c-a1f7f2b2196d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:40.760734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f5bef-0f8c-4c6d-b62c-a1f7f2b2196d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7c6f5bef-0f8c-4c6d-b62c-a1f7f2b2196d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:40.771482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:40.772875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:40.774263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 384/779] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:40.776577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f5bef-0f8c-4c6d-b62c-a1f7f2b2196d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:40.823574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 396/780] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:58:40 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/7790d6ec0e524ee6a31fd06fda9c4ac7/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:58:40.825377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557c8b-5be6-4032-8623-15b43ccfee32 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:40.825716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557c8b-5be6-4032-8623-15b43ccfee32 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:40.826097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557c8b-5be6-4032-8623-15b43ccfee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:40.834714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:40.849542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7b557c8b-5be6-4032-8623-15b43ccfee32 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:40.851091 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7b557c8b-5be6-4032-8623-15b43ccfee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:40.986446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 397/781] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:40.988782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b557c8b-5be6-4032-8623-15b43ccfee32 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:40.990428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f5bef-0f8c-4c6d-b62c-a1f7f2b2196d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:41.074710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963737db-3595-4a38-bddf-be9889c916f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:41.075646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963737db-3595-4a38-bddf-be9889c916f6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:41.076109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963737db-3595-4a38-bddf-be9889c916f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:41.076626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963737db-3595-4a38-bddf-be9889c916f6 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:41.077744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963737db-3595-4a38-bddf-be9889c916f6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:41.078250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963737db-3595-4a38-bddf-be9889c916f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:41.080431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963737db-3595-4a38-bddf-be9889c916f6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:41.090056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 385/782] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 1 11:58:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:41.104261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963737db-3595-4a38-bddf-be9889c916f6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:41.174657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:41.185315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b557c8b-5be6-4032-8623-15b43ccfee32 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:41.269367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963737db-3595-4a38-bddf-be9889c916f6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:41.274393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:41.293131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d05a-aab1-48ca-9b0a-ef033c6914d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:41.293726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d05a-aab1-48ca-9b0a-ef033c6914d2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:41.294004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d05a-aab1-48ca-9b0a-ef033c6914d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:41.294283 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d05a-aab1-48ca-9b0a-ef033c6914d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:41.294967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132d05a-aab1-48ca-9b0a-ef033c6914d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:41.295527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132d05a-aab1-48ca-9b0a-ef033c6914d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:41.297331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132d05a-aab1-48ca-9b0a-ef033c6914d2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:41.318027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 398/783] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:41.319740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d05a-aab1-48ca-9b0a-ef033c6914d2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:41.336403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68367c-ba2f-4dc7-9ed7-045f81f2a49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:41.337651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68367c-ba2f-4dc7-9ed7-045f81f2a49b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:41.338159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68367c-ba2f-4dc7-9ed7-045f81f2a49b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:41.338660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68367c-ba2f-4dc7-9ed7-045f81f2a49b None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:41.339580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68367c-ba2f-4dc7-9ed7-045f81f2a49b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:41.340137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68367c-ba2f-4dc7-9ed7-045f81f2a49b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:41.342766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68367c-ba2f-4dc7-9ed7-045f81f2a49b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:41.352442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 386/784] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 1 11:58:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:41.353955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68367c-ba2f-4dc7-9ed7-045f81f2a49b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:41.473837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68367c-ba2f-4dc7-9ed7-045f81f2a49b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:41.500630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:41.510514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d05a-aab1-48ca-9b0a-ef033c6914d2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:41.516882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be63478-c134-4cc9-88f3-f93e1e1071f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:41.517869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be63478-c134-4cc9-88f3-f93e1e1071f2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:41.518345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be63478-c134-4cc9-88f3-f93e1e1071f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:41.518801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be63478-c134-4cc9-88f3-f93e1e1071f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:41.533109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be63478-c134-4cc9-88f3-f93e1e1071f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:41.534975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be63478-c134-4cc9-88f3-f93e1e1071f2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9be63478-c134-4cc9-88f3-f93e1e1071f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:41.555991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:41.557806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:41.558939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:41.558939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:41.558939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:41.558939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 387/785] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:41.558939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be63478-c134-4cc9-88f3-f93e1e1071f2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:41.582694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9109-167f-4f98-8dea-9bf4ca28a18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:41.584695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9109-167f-4f98-8dea-9bf4ca28a18e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:41.585181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9109-167f-4f98-8dea-9bf4ca28a18e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:41.585606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9109-167f-4f98-8dea-9bf4ca28a18e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:41.603814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b9109-167f-4f98-8dea-9bf4ca28a18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-347b9109-167f-4f98-8dea-9bf4ca28a18e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:41.611261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:41.612487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:41.613342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:41.613984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 399/786] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:41.614867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9109-167f-4f98-8dea-9bf4ca28a18e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:41.704562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:41.715810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be63478-c134-4cc9-88f3-f93e1e1071f2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:41.762158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5144d9e-30d4-446a-8bb1-6cacce809431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:41.762980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5144d9e-30d4-446a-8bb1-6cacce809431 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:41.763332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5144d9e-30d4-446a-8bb1-6cacce809431 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:41.763719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5144d9e-30d4-446a-8bb1-6cacce809431 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:41.764584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5144d9e-30d4-446a-8bb1-6cacce809431 None admin] RBAC: Adding query filter params (interface=public, service_id=24a13fd2bde249c1be3229fe83b2f822, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:41.764971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5144d9e-30d4-446a-8bb1-6cacce809431 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:41.766497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5144d9e-30d4-446a-8bb1-6cacce809431 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:41.780729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 388/787] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 1 11:58:41 2022] GET /identity/v3/endpoints?service_id=24a13fd2bde249c1be3229fe83b2f822&interface=public®ion_id=RegionOne => generated 194 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:41.781909 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5144d9e-30d4-446a-8bb1-6cacce809431 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:41.900901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9109-167f-4f98-8dea-9bf4ca28a18e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:41.927849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:41.948391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59d8a5-2b6d-4fbc-990b-ea034bfb536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:41.949501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d8a5-2b6d-4fbc-990b-ea034bfb536a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:41.950825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d8a5-2b6d-4fbc-990b-ea034bfb536a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:41.951321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d8a5-2b6d-4fbc-990b-ea034bfb536a None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:41.952288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59d8a5-2b6d-4fbc-990b-ea034bfb536a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:41.952785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59d8a5-2b6d-4fbc-990b-ea034bfb536a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:41.954363 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59d8a5-2b6d-4fbc-990b-ea034bfb536a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:41.972100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 400/788] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:41.973663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59d8a5-2b6d-4fbc-990b-ea034bfb536a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:42.036807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5144d9e-30d4-446a-8bb1-6cacce809431 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:42.095101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d905c-8e6b-4a53-9e00-bbf97d5a8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:42.096695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d905c-8e6b-4a53-9e00-bbf97d5a8920 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:42.097491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d905c-8e6b-4a53-9e00-bbf97d5a8920 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:42.098281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d905c-8e6b-4a53-9e00-bbf97d5a8920 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:42.100369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d905c-8e6b-4a53-9e00-bbf97d5a8920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:42.101294 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d905c-8e6b-4a53-9e00-bbf97d5a8920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:42.104197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d905c-8e6b-4a53-9e00-bbf97d5a8920 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:42.116037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59d8a5-2b6d-4fbc-990b-ea034bfb536a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:42.120082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 389/789] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:42.121458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d905c-8e6b-4a53-9e00-bbf97d5a8920 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:42.135388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:42.174100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7645-ad40-4b6d-8061-d0b804914cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:42.175113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7645-ad40-4b6d-8061-d0b804914cae None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:42.175639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7645-ad40-4b6d-8061-d0b804914cae None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:42.176295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7645-ad40-4b6d-8061-d0b804914cae None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:42.177121 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa7645-ad40-4b6d-8061-d0b804914cae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:42.178785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa7645-ad40-4b6d-8061-d0b804914cae None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:42.184876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 401/790] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 1 11:58:41 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:42.186029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7645-ad40-4b6d-8061-d0b804914cae None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:42.300514 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:42.348523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7645-ad40-4b6d-8061-d0b804914cae None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:42.360435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d905c-8e6b-4a53-9e00-bbf97d5a8920 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:42.417207 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599641e-4edb-4ccd-a7be-a0138f2ec058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:42.417891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599641e-4edb-4ccd-a7be-a0138f2ec058 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:42.418178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599641e-4edb-4ccd-a7be-a0138f2ec058 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:42.418460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599641e-4edb-4ccd-a7be-a0138f2ec058 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:42.423142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185d57f-3f6e-4416-ab88-dffb3a786102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:42.423823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185d57f-3f6e-4416-ab88-dffb3a786102 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:42.424175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185d57f-3f6e-4416-ab88-dffb3a786102 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:42.424441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185d57f-3f6e-4416-ab88-dffb3a786102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:42.433218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599641e-4edb-4ccd-a7be-a0138f2ec058 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:42.434679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599641e-4edb-4ccd-a7be-a0138f2ec058 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:42.447903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185d57f-3f6e-4416-ab88-dffb3a786102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:42.449450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185d57f-3f6e-4416-ab88-dffb3a786102 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-1599641e-4edb-4ccd-a7be-a0138f2ec058 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:42.453975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:42.455001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:42.455941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:42.455941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:42.455941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:42.455941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:42.455941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:42.455941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:42.455941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:42.455941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:42.455941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:58:42.455941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:42.464013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 390/791] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 1 11:58:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:42.465882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599641e-4edb-4ccd-a7be-a0138f2ec058 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-5185d57f-3f6e-4416-ab88-dffb3a786102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:42.486488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:42.487498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:42.488923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:42.488923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:42.488923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:42.490613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 402/792] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:42.501716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185d57f-3f6e-4416-ab88-dffb3a786102 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:42.564616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:42.652868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185d57f-3f6e-4416-ab88-dffb3a786102 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:42.712670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599641e-4edb-4ccd-a7be-a0138f2ec058 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:42.733426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074be76-794d-4d5f-af25-ded50fd9ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:42.741868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074be76-794d-4d5f-af25-ded50fd9ac49 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:42.742534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074be76-794d-4d5f-af25-ded50fd9ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:42.743026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074be76-794d-4d5f-af25-ded50fd9ac49 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:42.743982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074be76-794d-4d5f-af25-ded50fd9ac49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:42.744644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074be76-794d-4d5f-af25-ded50fd9ac49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:42.746263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074be76-794d-4d5f-af25-ded50fd9ac49 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:42.765638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 403/793] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:42.767155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e25613-e4b7-414b-a7e7-3c0404330290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:42.767787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e25613-e4b7-414b-a7e7-3c0404330290 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:42.768064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e25613-e4b7-414b-a7e7-3c0404330290 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:42.768376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e25613-e4b7-414b-a7e7-3c0404330290 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:42.769203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e25613-e4b7-414b-a7e7-3c0404330290 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:42.769515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e25613-e4b7-414b-a7e7-3c0404330290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:42.771067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e25613-e4b7-414b-a7e7-3c0404330290 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:42.774272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074be76-794d-4d5f-af25-ded50fd9ac49 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:42.785212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:42.812336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 391/794] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 1 11:58:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:42.813892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e25613-e4b7-414b-a7e7-3c0404330290 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:42.926478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e25613-e4b7-414b-a7e7-3c0404330290 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:42.966399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45afade-f4f1-4e28-971c-eb397eb98700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:42.966987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45afade-f4f1-4e28-971c-eb397eb98700 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:42.967277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45afade-f4f1-4e28-971c-eb397eb98700 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:42.967684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45afade-f4f1-4e28-971c-eb397eb98700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:42.978981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45afade-f4f1-4e28-971c-eb397eb98700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:42.980550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45afade-f4f1-4e28-971c-eb397eb98700 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b45afade-f4f1-4e28-971c-eb397eb98700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:42.997116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:42.998106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:42.998977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:42.998977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:42.998977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:42.999147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074be76-794d-4d5f-af25-ded50fd9ac49 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:43.003291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 392/795] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:43.004825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e21f-c27a-4a9d-9951-eb0c9fbead74 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:43.005180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e21f-c27a-4a9d-9951-eb0c9fbead74 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:43.005458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e21f-c27a-4a9d-9951-eb0c9fbead74 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:43.008020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 393/796] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:43.014095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8e21f-c27a-4a9d-9951-eb0c9fbead74 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:43.014624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:43.071456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c436127-cb8f-489e-ab93-0ad296db96bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:43.072718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c436127-cb8f-489e-ab93-0ad296db96bf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:43.073285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c436127-cb8f-489e-ab93-0ad296db96bf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:43.073678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c436127-cb8f-489e-ab93-0ad296db96bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:43.084730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:43.092310 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c436127-cb8f-489e-ab93-0ad296db96bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:43.095554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c436127-cb8f-489e-ab93-0ad296db96bf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8c436127-cb8f-489e-ab93-0ad296db96bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:43.119414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:43.121271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:43.122249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:43.122249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:43.122249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:43.122249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:43.122249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:43.122249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:43.122249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:43.122249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:43.122249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:43.122249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:43.124411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 404/797] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:43.127428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915de76-feef-4dab-9aef-ec4affe1cbce None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:43.128393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915de76-feef-4dab-9aef-ec4affe1cbce None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:43.128876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915de76-feef-4dab-9aef-ec4affe1cbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:43.153735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8e21f-c27a-4a9d-9951-eb0c9fbead74 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:43.156991 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1915de76-feef-4dab-9aef-ec4affe1cbce None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:43.159502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1915de76-feef-4dab-9aef-ec4affe1cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:43.193566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a759784-ad7e-4813-9dc0-77098ec974f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:43.194177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a759784-ad7e-4813-9dc0-77098ec974f9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:43.194449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a759784-ad7e-4813-9dc0-77098ec974f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:43.194721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a759784-ad7e-4813-9dc0-77098ec974f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:43.195475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a759784-ad7e-4813-9dc0-77098ec974f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:43.195676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a759784-ad7e-4813-9dc0-77098ec974f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:43.197114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a759784-ad7e-4813-9dc0-77098ec974f9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:43.215257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 394/798] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:43.215257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34308b-5022-49a8-8648-8856ac643ad2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:43.215257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34308b-5022-49a8-8648-8856ac643ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:43.215257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34308b-5022-49a8-8648-8856ac643ad2 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:43.215257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 395/799] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:43.215257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34308b-5022-49a8-8648-8856ac643ad2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:43.262416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 405/800] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:43.263611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915de76-feef-4dab-9aef-ec4affe1cbce None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:43.383278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:43.385626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34308b-5022-49a8-8648-8856ac643ad2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:43.395304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:43.409813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915de76-feef-4dab-9aef-ec4affe1cbce None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:43.425420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48bd4d-eb2b-45b3-9cfa-e92024983a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:43.426411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48bd4d-eb2b-45b3-9cfa-e92024983a69 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:43.426920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48bd4d-eb2b-45b3-9cfa-e92024983a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:43.427416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48bd4d-eb2b-45b3-9cfa-e92024983a69 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:43.429011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48bd4d-eb2b-45b3-9cfa-e92024983a69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:43.429574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48bd4d-eb2b-45b3-9cfa-e92024983a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:43.431241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48bd4d-eb2b-45b3-9cfa-e92024983a69 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:43.458035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 396/801] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 1 11:58:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:43.459601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c59f28-085e-48cb-a232-336aa8527d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:43.460302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c59f28-085e-48cb-a232-336aa8527d35 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:43.460585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c59f28-085e-48cb-a232-336aa8527d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:43.460905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c59f28-085e-48cb-a232-336aa8527d35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:43.462405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3a864-00b2-478a-908e-0f97ab4009af None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:43.463122 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3a864-00b2-478a-908e-0f97ab4009af None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:43.463794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3a864-00b2-478a-908e-0f97ab4009af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:43.469347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c59f28-085e-48cb-a232-336aa8527d35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:43.470843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c59f28-085e-48cb-a232-336aa8527d35 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-59c59f28-085e-48cb-a232-336aa8527d35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:43.486045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:43.488084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:43.490002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:43.490002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:43.490002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:43.490002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:43.490002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:43.490002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:43.490002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:43.490002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:43.493052 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 406/802] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:43.494046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c59f28-085e-48cb-a232-336aa8527d35 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:43.506383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dfa3a864-00b2-478a-908e-0f97ab4009af None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:43.509228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dfa3a864-00b2-478a-908e-0f97ab4009af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:43.640563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 397/803] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:43.641628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3a864-00b2-478a-908e-0f97ab4009af None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:43.676605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c59f28-085e-48cb-a232-336aa8527d35 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:43.745348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135a67e-3bc1-4e71-afca-d8caff5c7c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:43.746622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135a67e-3bc1-4e71-afca-d8caff5c7c68 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:43.747093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135a67e-3bc1-4e71-afca-d8caff5c7c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:43.747560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135a67e-3bc1-4e71-afca-d8caff5c7c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:43.765847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:43.767538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:43.772104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135a67e-3bc1-4e71-afca-d8caff5c7c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:43.774438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135a67e-3bc1-4e71-afca-d8caff5c7c68 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:43.775789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3a864-00b2-478a-908e-0f97ab4009af None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-5135a67e-3bc1-4e71-afca-d8caff5c7c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:43.799765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:43.800986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:43.801962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:43.801962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:43.801962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:43.801962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 407/804] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:43.804312 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135a67e-3bc1-4e71-afca-d8caff5c7c68 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:43.821357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa82d-698a-46ce-9967-c1232a342915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:43.822410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa82d-698a-46ce-9967-c1232a342915 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:43.822845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa82d-698a-46ce-9967-c1232a342915 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:43.823318 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa82d-698a-46ce-9967-c1232a342915 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:43.824175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa82d-698a-46ce-9967-c1232a342915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:43.824690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa82d-698a-46ce-9967-c1232a342915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:43.826402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa82d-698a-46ce-9967-c1232a342915 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:43.843913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 398/805] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:43.845158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa82d-698a-46ce-9967-c1232a342915 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:43.967325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa82d-698a-46ce-9967-c1232a342915 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:44.008800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea64a06-08b6-4400-88e8-13ce54ddfeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:44.009787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea64a06-08b6-4400-88e8-13ce54ddfeda None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:44.010263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea64a06-08b6-4400-88e8-13ce54ddfeda None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:44.010693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea64a06-08b6-4400-88e8-13ce54ddfeda None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:44.011135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135a67e-3bc1-4e71-afca-d8caff5c7c68 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:44.011679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea64a06-08b6-4400-88e8-13ce54ddfeda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:44.012143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea64a06-08b6-4400-88e8-13ce54ddfeda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:44.013719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea64a06-08b6-4400-88e8-13ce54ddfeda None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:44.028274 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 399/806] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:44.029641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea64a06-08b6-4400-88e8-13ce54ddfeda None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:44.048865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:44.077657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65f7d4-67c8-4115-8d50-a866caab2ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:44.079150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65f7d4-67c8-4115-8d50-a866caab2ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:44.079150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65f7d4-67c8-4115-8d50-a866caab2ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:44.079562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65f7d4-67c8-4115-8d50-a866caab2ef9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:44.080447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65f7d4-67c8-4115-8d50-a866caab2ef9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:44.083092 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65f7d4-67c8-4115-8d50-a866caab2ef9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-4b65f7d4-67c8-4115-8d50-a866caab2ef9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:44.100831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:44.102171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 11:58:44.103135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:44.103885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 408/807] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:43 2022] GET /identity/v3/services/network => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:44.106802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65f7d4-67c8-4115-8d50-a866caab2ef9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:44.162735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea64a06-08b6-4400-88e8-13ce54ddfeda None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:44.207220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168a881-5964-46d3-924f-6e10c4ec8dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:44.207985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168a881-5964-46d3-924f-6e10c4ec8dbf None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:44.208300 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168a881-5964-46d3-924f-6e10c4ec8dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:44.208580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168a881-5964-46d3-924f-6e10c4ec8dbf None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/9b9457f6eebd49e7858158a1706ec99d/roles/22cfc07169ee49d685af3262b384f78b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:44.227427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:44.237103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168a881-5964-46d3-924f-6e10c4ec8dbf None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=9b9457f6eebd49e7858158a1706ec99d, role_id=22cfc07169ee49d685af3262b384f78b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:44.239924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168a881-5964-46d3-924f-6e10c4ec8dbf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:44.288280 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65f7d4-67c8-4115-8d50-a866caab2ef9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:44.334265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb142c6-a9a1-4a47-bca4-6aa8ac8322ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:44.335374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb142c6-a9a1-4a47-bca4-6aa8ac8322ff None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:44.335867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb142c6-a9a1-4a47-bca4-6aa8ac8322ff None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:44.336387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb142c6-a9a1-4a47-bca4-6aa8ac8322ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:44.349044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb142c6-a9a1-4a47-bca4-6aa8ac8322ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:44.352483 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb142c6-a9a1-4a47-bca4-6aa8ac8322ff None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:44.372079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 400/808] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:58:44 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/9b9457f6eebd49e7858158a1706ec99d/roles/22cfc07169ee49d685af3262b384f78b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:58:44.373927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168a881-5964-46d3-924f-6e10c4ec8dbf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6fb142c6-a9a1-4a47-bca4-6aa8ac8322ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:44.374715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:44.376382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:44.378089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:44.378089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:44.378089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:44.378089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:44.378089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:44.378089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:44.378089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:44.378089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:44.384751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 409/809] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:44.386409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb142c6-a9a1-4a47-bca4-6aa8ac8322ff None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:44.493469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:44.550157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168a881-5964-46d3-924f-6e10c4ec8dbf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:44.593967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb142c6-a9a1-4a47-bca4-6aa8ac8322ff None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:44.607665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb3384-c812-4e8b-a628-bd037f879740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:44.608427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb3384-c812-4e8b-a628-bd037f879740 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:44.608849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb3384-c812-4e8b-a628-bd037f879740 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:44.609264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb3384-c812-4e8b-a628-bd037f879740 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:44.610114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb3384-c812-4e8b-a628-bd037f879740 None admin] RBAC: Adding query filter params (name=network) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:44.610539 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb3384-c812-4e8b-a628-bd037f879740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:44.612144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb3384-c812-4e8b-a628-bd037f879740 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:44.618260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 401/810] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:58:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:44.619043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:44.619352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb3384-c812-4e8b-a628-bd037f879740 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:44.652460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73b4e8-8b8e-4267-a45c-2093bf7b1655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:44.653533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b4e8-8b8e-4267-a45c-2093bf7b1655 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:44.654029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b4e8-8b8e-4267-a45c-2093bf7b1655 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:44.654509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b4e8-8b8e-4267-a45c-2093bf7b1655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:44.675142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73b4e8-8b8e-4267-a45c-2093bf7b1655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-1c73b4e8-8b8e-4267-a45c-2093bf7b1655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:44.687431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:44.689708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 410/811] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:44.698329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd2f43-6469-44a0-b0ba-b26cdfe8e4a9 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:44.700112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd2f43-6469-44a0-b0ba-b26cdfe8e4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:44.700112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd2f43-6469-44a0-b0ba-b26cdfe8e4a9 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:44.700112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 411/812] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:44.700112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd2f43-6469-44a0-b0ba-b26cdfe8e4a9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:44.776874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb3384-c812-4e8b-a628-bd037f879740 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:44.808706 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:44.822637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee8e45-4ae4-46e4-8761-039e2de376c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:44.823427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8e45-4ae4-46e4-8761-039e2de376c3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:44.823728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8e45-4ae4-46e4-8761-039e2de376c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:44.824013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8e45-4ae4-46e4-8761-039e2de376c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:44.824782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee8e45-4ae4-46e4-8761-039e2de376c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:44.825097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee8e45-4ae4-46e4-8761-039e2de376c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:44.826656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee8e45-4ae4-46e4-8761-039e2de376c3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:44.840612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 402/813] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:44.841932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb77b1-3c68-48da-a577-c04540e4645c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:44.842221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb77b1-3c68-48da-a577-c04540e4645c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:44.842502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb77b1-3c68-48da-a577-c04540e4645c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:44.858890 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd2f43-6469-44a0-b0ba-b26cdfe8e4a9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:44.862441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d9fb77b1-3c68-48da-a577-c04540e4645c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:44.863641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9fb77b1-3c68-48da-a577-c04540e4645c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:44.897626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe77ab5-6133-479f-b7ad-7b70e7e18e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:44.898247 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe77ab5-6133-479f-b7ad-7b70e7e18e4e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:44.898525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe77ab5-6133-479f-b7ad-7b70e7e18e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:44.898788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe77ab5-6133-479f-b7ad-7b70e7e18e4e None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:44.899433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe77ab5-6133-479f-b7ad-7b70e7e18e4e None admin] RBAC: Adding query filter params (type=network) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:44.899741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe77ab5-6133-479f-b7ad-7b70e7e18e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:44.901197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe77ab5-6133-479f-b7ad-7b70e7e18e4e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:44.912171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 412/814] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:58:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:44.912171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe77ab5-6133-479f-b7ad-7b70e7e18e4e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:44.960941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 403/815] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:44.961843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb77b1-3c68-48da-a577-c04540e4645c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:44.993880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:45.139537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe77ab5-6133-479f-b7ad-7b70e7e18e4e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:45.202869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb77b1-3c68-48da-a577-c04540e4645c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:45.215504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cf917-22d6-4483-8541-7d66c7dc6228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:45.216549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cf917-22d6-4483-8541-7d66c7dc6228 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:45.217245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cf917-22d6-4483-8541-7d66c7dc6228 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:45.217714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cf917-22d6-4483-8541-7d66c7dc6228 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:45.218893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cf917-22d6-4483-8541-7d66c7dc6228 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:45.219442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cf917-22d6-4483-8541-7d66c7dc6228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:45.222039 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cf917-22d6-4483-8541-7d66c7dc6228 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:45.238936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 413/816] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:45.240992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cf917-22d6-4483-8541-7d66c7dc6228 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:45.247234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:45.288854 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bf7c1-1d91-4782-8074-7afcd0905c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:45.290555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf7c1-1d91-4782-8074-7afcd0905c56 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:45.291479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf7c1-1d91-4782-8074-7afcd0905c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:45.292254 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf7c1-1d91-4782-8074-7afcd0905c56 None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/8a59a4732ec14a838be9c838dbeb7fd0/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:45.298089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bf7c1-1d91-4782-8074-7afcd0905c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=8a59a4732ec14a838be9c838dbeb7fd0, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:45.301315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bf7c1-1d91-4782-8074-7afcd0905c56 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:45.362064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 404/817] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:58:44 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/8a59a4732ec14a838be9c838dbeb7fd0/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:58:45.364274 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bf7c1-1d91-4782-8074-7afcd0905c56 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:45.493199 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cf917-22d6-4483-8541-7d66c7dc6228 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:45.497601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:45.572855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fe61c-e2fc-40d8-9800-efaa39a4df90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:45.573883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe61c-e2fc-40d8-9800-efaa39a4df90 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:45.574376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe61c-e2fc-40d8-9800-efaa39a4df90 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:45.574858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe61c-e2fc-40d8-9800-efaa39a4df90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:45.575421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bf7c1-1d91-4782-8074-7afcd0905c56 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:45.576162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fe61c-e2fc-40d8-9800-efaa39a4df90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:45.578856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fe61c-e2fc-40d8-9800-efaa39a4df90 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:45.642344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c178e-8670-4924-9505-3d26d328c077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:45.643650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c178e-8670-4924-9505-3d26d328c077 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:45.644114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c178e-8670-4924-9505-3d26d328c077 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:45.644674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c178e-8670-4924-9505-3d26d328c077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:45.668445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c178e-8670-4924-9505-3d26d328c077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:45.671905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c178e-8670-4924-9505-3d26d328c077 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:45.680490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 414/818] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 11:58:45 2022] POST /identity/v3/endpoints => generated 337 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:58:45.682583 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fe61c-e2fc-40d8-9800-efaa39a4df90 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ef7c178e-8670-4924-9505-3d26d328c077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:45.713561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:45.715460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:45.717258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:45.717258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:45.717258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:45.722281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 405/819] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:45.728181 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c178e-8670-4924-9505-3d26d328c077 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:45.804489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:45.969524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c178e-8670-4924-9505-3d26d328c077 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:46.059668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2395d-a621-4ebd-95ed-43837e7e33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:46.061074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2395d-a621-4ebd-95ed-43837e7e33e7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:46.061772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2395d-a621-4ebd-95ed-43837e7e33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:46.062686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2395d-a621-4ebd-95ed-43837e7e33e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:46.064619 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2395d-a621-4ebd-95ed-43837e7e33e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:46.065731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2395d-a621-4ebd-95ed-43837e7e33e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:46.069539 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2395d-a621-4ebd-95ed-43837e7e33e7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:46.071826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fe61c-e2fc-40d8-9800-efaa39a4df90 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:46.098150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 406/820] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:46.105249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2395d-a621-4ebd-95ed-43837e7e33e7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:46.150202 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4d3b7-2de5-46fc-860d-70aeb5e6d8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:46.151239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4d3b7-2de5-46fc-860d-70aeb5e6d8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:46.151797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4d3b7-2de5-46fc-860d-70aeb5e6d8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:46.152356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4d3b7-2de5-46fc-860d-70aeb5e6d8d8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:46.153179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4d3b7-2de5-46fc-860d-70aeb5e6d8d8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:46.155369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4d3b7-2de5-46fc-860d-70aeb5e6d8d8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-4ff4d3b7-2de5-46fc-860d-70aeb5e6d8d8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:46.166301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:46.167362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 11:58:46.168194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:46.171434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 415/821] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Sep 1 11:58:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:46.181785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4d3b7-2de5-46fc-860d-70aeb5e6d8d8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:46.214986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:46.307126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:46.320389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4d3b7-2de5-46fc-860d-70aeb5e6d8d8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:46.339674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2395d-a621-4ebd-95ed-43837e7e33e7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:46.367378 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ba98c-eb8b-48d8-b431-41d17f8f0093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:46.368374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ba98c-eb8b-48d8-b431-41d17f8f0093 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:46.369127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ba98c-eb8b-48d8-b431-41d17f8f0093 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:46.369597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ba98c-eb8b-48d8-b431-41d17f8f0093 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:46.370419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ba98c-eb8b-48d8-b431-41d17f8f0093 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:46.370917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ba98c-eb8b-48d8-b431-41d17f8f0093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:46.372812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ba98c-eb8b-48d8-b431-41d17f8f0093 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:46.379254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 416/822] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 1 11:58:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:46.386158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ba98c-eb8b-48d8-b431-41d17f8f0093 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:46.414753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69069e-26ac-4317-b439-a0d045f75233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:46.416124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69069e-26ac-4317-b439-a0d045f75233 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:46.416556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69069e-26ac-4317-b439-a0d045f75233 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:46.417095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69069e-26ac-4317-b439-a0d045f75233 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:46.434505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69069e-26ac-4317-b439-a0d045f75233 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:46.438334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69069e-26ac-4317-b439-a0d045f75233 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-4f69069e-26ac-4317-b439-a0d045f75233 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:46.460849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:46.462625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:46.464457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:46.464457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:46.464457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:46.464457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:46.464457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:46.464457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:46.464457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:46.464457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:46.464457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:58:46.464457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:46.468617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 407/823] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 1 11:58:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:46.472940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69069e-26ac-4317-b439-a0d045f75233 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:46.537219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:46.567894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ba98c-eb8b-48d8-b431-41d17f8f0093 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:46.631506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6076b06-2363-4b87-9186-8b0612c1a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:46.631723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69069e-26ac-4317-b439-a0d045f75233 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:46.632313 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6076b06-2363-4b87-9186-8b0612c1a6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:46.632509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6076b06-2363-4b87-9186-8b0612c1a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:46.632738 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6076b06-2363-4b87-9186-8b0612c1a6b7 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:46.633383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6076b06-2363-4b87-9186-8b0612c1a6b7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:46.633692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6076b06-2363-4b87-9186-8b0612c1a6b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:46.635081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6076b06-2363-4b87-9186-8b0612c1a6b7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:46.645162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 417/824] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Sep 1 11:58:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:46.645162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101facc-aaf4-4746-bdee-cc92d175686d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:46.648364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101facc-aaf4-4746-bdee-cc92d175686d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:46.648670 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101facc-aaf4-4746-bdee-cc92d175686d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:46.650319 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 418/825] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:46.650923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101facc-aaf4-4746-bdee-cc92d175686d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:46.697265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e39800-98fe-46c3-af06-1ea2291f4214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:46.698030 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39800-98fe-46c3-af06-1ea2291f4214 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:46.698480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39800-98fe-46c3-af06-1ea2291f4214 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:46.698928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e39800-98fe-46c3-af06-1ea2291f4214 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:46.700189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e39800-98fe-46c3-af06-1ea2291f4214 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:46.700718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e39800-98fe-46c3-af06-1ea2291f4214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:46.703205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e39800-98fe-46c3-af06-1ea2291f4214 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:46.739511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 408/826] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 1 11:58:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:46.739511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467040e-5358-4487-9df8-ce66e760c626 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:46.739511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467040e-5358-4487-9df8-ce66e760c626 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:46.739511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467040e-5358-4487-9df8-ce66e760c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:46.747283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:46.764524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1467040e-5358-4487-9df8-ce66e760c626 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:46.765937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1467040e-5358-4487-9df8-ce66e760c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:46.800298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101facc-aaf4-4746-bdee-cc92d175686d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:46.841010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b5dfe-2520-4fba-af0e-5cd61e9c4cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:46.841644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b5dfe-2520-4fba-af0e-5cd61e9c4cee None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:46.841923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b5dfe-2520-4fba-af0e-5cd61e9c4cee None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:46.842201 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b5dfe-2520-4fba-af0e-5cd61e9c4cee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:46.842902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b5dfe-2520-4fba-af0e-5cd61e9c4cee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:46.844376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b5dfe-2520-4fba-af0e-5cd61e9c4cee None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:46.860566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 409/827] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:46.861410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467040e-5358-4487-9df8-ce66e760c626 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:46.981026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 419/828] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 11:58:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:58:47.015093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467040e-5358-4487-9df8-ce66e760c626 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:47.083778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:47.093778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d6bac-5c86-49ca-ab16-5af92cf1960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:47.094735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d6bac-5c86-49ca-ab16-5af92cf1960a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:47.095163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d6bac-5c86-49ca-ab16-5af92cf1960a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:47.095574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d6bac-5c86-49ca-ab16-5af92cf1960a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:47.230360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d6bac-5c86-49ca-ab16-5af92cf1960a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:47.233141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d6bac-5c86-49ca-ab16-5af92cf1960a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:47.338282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b5dfe-2520-4fba-af0e-5cd61e9c4cee None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:47.349056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:47.403281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 410/829] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:46 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 11:58:47.412780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d6bac-5c86-49ca-ab16-5af92cf1960a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:47.471585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:47.538767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b5dfe-2520-4fba-af0e-5cd61e9c4cee None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:47.600118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb96add-ba19-4029-b914-b8a301e3743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:47.601177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb96add-ba19-4029-b914-b8a301e3743f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:47.601645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb96add-ba19-4029-b914-b8a301e3743f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:47.602105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb96add-ba19-4029-b914-b8a301e3743f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:47.609745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d6bac-5c86-49ca-ab16-5af92cf1960a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:47.620847 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb96add-ba19-4029-b914-b8a301e3743f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-7fb96add-ba19-4029-b914-b8a301e3743f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:47.632045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:47.633872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:47.634954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 420/830] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 11:58:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:47.647034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb96add-ba19-4029-b914-b8a301e3743f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:47.670146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046076c8-43f2-47ac-aeee-b691f41a0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:47.671037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046076c8-43f2-47ac-aeee-b691f41a0da4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:47.671381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046076c8-43f2-47ac-aeee-b691f41a0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:47.671767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046076c8-43f2-47ac-aeee-b691f41a0da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:47.693729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046076c8-43f2-47ac-aeee-b691f41a0da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:47.695354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046076c8-43f2-47ac-aeee-b691f41a0da4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-046076c8-43f2-47ac-aeee-b691f41a0da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:47.716801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:47.718554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:47.720322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:47.720322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:47.720322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:47.720322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 411/831] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:47.725067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046076c8-43f2-47ac-aeee-b691f41a0da4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:47.767236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:47.815377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb96add-ba19-4029-b914-b8a301e3743f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:47.860684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eabc94-c8d6-44e8-a612-aca85560debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:47.861309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eabc94-c8d6-44e8-a612-aca85560debb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:47.861590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eabc94-c8d6-44e8-a612-aca85560debb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:47.861857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eabc94-c8d6-44e8-a612-aca85560debb None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:47.862547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eabc94-c8d6-44e8-a612-aca85560debb None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:47.862885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eabc94-c8d6-44e8-a612-aca85560debb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:47.864311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eabc94-c8d6-44e8-a612-aca85560debb None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:47.880357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 421/832] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 11:58:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:47.883976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eabc94-c8d6-44e8-a612-aca85560debb None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:47.900735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:47.917185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046076c8-43f2-47ac-aeee-b691f41a0da4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:47.966319 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412e1f0-421e-4482-8ff3-35681690a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:47.966997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412e1f0-421e-4482-8ff3-35681690a600 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:47.967296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412e1f0-421e-4482-8ff3-35681690a600 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:47.968146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412e1f0-421e-4482-8ff3-35681690a600 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:47.968998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412e1f0-421e-4482-8ff3-35681690a600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:47.969314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412e1f0-421e-4482-8ff3-35681690a600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:47.971040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412e1f0-421e-4482-8ff3-35681690a600 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:47.987749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 412/833] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:47.997887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412e1f0-421e-4482-8ff3-35681690a600 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:48.064628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eabc94-c8d6-44e8-a612-aca85560debb None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:48.101632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:48.117231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33939fc7-4c40-405e-b7f7-9de884c55785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:48.118498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33939fc7-4c40-405e-b7f7-9de884c55785 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:48.119093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33939fc7-4c40-405e-b7f7-9de884c55785 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:48.119564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33939fc7-4c40-405e-b7f7-9de884c55785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:48.138424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33939fc7-4c40-405e-b7f7-9de884c55785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:48.140992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33939fc7-4c40-405e-b7f7-9de884c55785 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:48.166947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412e1f0-421e-4482-8ff3-35681690a600 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-33939fc7-4c40-405e-b7f7-9de884c55785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:48.167928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:48.170355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:48.172545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:48.172545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:48.172545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:48.172545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 422/834] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:48.172972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf4641-197b-45a3-9279-949c581fe96c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:48.173342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf4641-197b-45a3-9279-949c581fe96c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:48.173826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf4641-197b-45a3-9279-949c581fe96c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:48.177213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 423/835] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:48.178318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf4641-197b-45a3-9279-949c581fe96c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:48.220882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ac129-dfae-439e-9815-5a677008250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:48.221926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ac129-dfae-439e-9815-5a677008250a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:48.222271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ac129-dfae-439e-9815-5a677008250a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:48.222706 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ac129-dfae-439e-9815-5a677008250a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:48.231522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ac129-dfae-439e-9815-5a677008250a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:48.233168 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ac129-dfae-439e-9815-5a677008250a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f57ac129-dfae-439e-9815-5a677008250a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:48.250942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:48.251911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:48.252863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:48.252863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:48.252863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:48.252863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:48.252863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:48.252863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:48.252863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:48.252863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:48.252863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 413/836] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:48.253969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af341042-c057-436c-adad-71a6ae089567 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:48.253969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af341042-c057-436c-adad-71a6ae089567 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:48.254143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af341042-c057-436c-adad-71a6ae089567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:48.263250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:48.280452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-af341042-c057-436c-adad-71a6ae089567 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:48.282053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af341042-c057-436c-adad-71a6ae089567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:48.338783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf4641-197b-45a3-9279-949c581fe96c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:48.365265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 414/837] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:48.366777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af341042-c057-436c-adad-71a6ae089567 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:48.387246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb33ce7-8ee9-4643-b0b6-507005e8916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:48.388343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb33ce7-8ee9-4643-b0b6-507005e8916b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:48.388654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb33ce7-8ee9-4643-b0b6-507005e8916b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:48.388968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb33ce7-8ee9-4643-b0b6-507005e8916b None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:48.389548 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb33ce7-8ee9-4643-b0b6-507005e8916b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:48.389851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb33ce7-8ee9-4643-b0b6-507005e8916b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:48.391416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb33ce7-8ee9-4643-b0b6-507005e8916b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:48.411050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 424/838] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:48.412434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb33ce7-8ee9-4643-b0b6-507005e8916b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:48.468934 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:48.536410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af341042-c057-436c-adad-71a6ae089567 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:48.571488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb33ce7-8ee9-4643-b0b6-507005e8916b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:48.599340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:48.612440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f434705-0e33-4b22-b115-7159bbaed25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:48.612775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f0847-fe74-4d2f-9ec1-070cbb77f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:48.613235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0847-fe74-4d2f-9ec1-070cbb77f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:48.613516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0847-fe74-4d2f-9ec1-070cbb77f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:48.613786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0847-fe74-4d2f-9ec1-070cbb77f3b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:48.615173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f434705-0e33-4b22-b115-7159bbaed25c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:48.616509 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f434705-0e33-4b22-b115-7159bbaed25c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:48.618250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f434705-0e33-4b22-b115-7159bbaed25c None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:48.619813 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f434705-0e33-4b22-b115-7159bbaed25c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:48.620720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f434705-0e33-4b22-b115-7159bbaed25c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:48.622673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f0847-fe74-4d2f-9ec1-070cbb77f3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:48.624131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f0847-fe74-4d2f-9ec1-070cbb77f3b2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:48.624988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f434705-0e33-4b22-b115-7159bbaed25c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-081f0847-fe74-4d2f-9ec1-070cbb77f3b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:48.638612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:48.640415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:48.642118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 425/839] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 1 11:58:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:48.646957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f0847-fe74-4d2f-9ec1-070cbb77f3b2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:48.657945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 415/840] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:48.667353 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f434705-0e33-4b22-b115-7159bbaed25c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:48.794090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:48.798307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f0847-fe74-4d2f-9ec1-070cbb77f3b2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:48.830587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f434705-0e33-4b22-b115-7159bbaed25c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:48.844100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51617615-00e2-4fd4-8b3d-7c93b91f66d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:48.844779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51617615-00e2-4fd4-8b3d-7c93b91f66d9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:48.845055 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51617615-00e2-4fd4-8b3d-7c93b91f66d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:48.845301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51617615-00e2-4fd4-8b3d-7c93b91f66d9 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:48.846146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51617615-00e2-4fd4-8b3d-7c93b91f66d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:48.846461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51617615-00e2-4fd4-8b3d-7c93b91f66d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:48.848523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51617615-00e2-4fd4-8b3d-7c93b91f66d9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:48.870588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 426/841] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 1 11:58:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:48.871484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51617615-00e2-4fd4-8b3d-7c93b91f66d9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:48.906377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996024-9cd8-4dea-a0b1-6c63c5bc1109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:48.907765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996024-9cd8-4dea-a0b1-6c63c5bc1109 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:48.908528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996024-9cd8-4dea-a0b1-6c63c5bc1109 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:48.909027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996024-9cd8-4dea-a0b1-6c63c5bc1109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:48.910479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01996024-9cd8-4dea-a0b1-6c63c5bc1109 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=7790d6ec0e524ee6a31fd06fda9c4ac7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:48.911050 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01996024-9cd8-4dea-a0b1-6c63c5bc1109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:48.913911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01996024-9cd8-4dea-a0b1-6c63c5bc1109 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:48.929386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 416/842] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:48 2022] GET /identity/v3/role_assignments?user.id=7790d6ec0e524ee6a31fd06fda9c4ac7&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:48.931759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996024-9cd8-4dea-a0b1-6c63c5bc1109 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:49.031308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:49.073553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51617615-00e2-4fd4-8b3d-7c93b91f66d9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:49.094776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996024-9cd8-4dea-a0b1-6c63c5bc1109 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:49.148156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e027e-c5bb-4e71-b2fe-320ce3dfd37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:49.148856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e027e-c5bb-4e71-b2fe-320ce3dfd37c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:49.149136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e027e-c5bb-4e71-b2fe-320ce3dfd37c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:49.149409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e027e-c5bb-4e71-b2fe-320ce3dfd37c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:49.151526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3428fe-6518-4e27-a351-b0a9f1ef02b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:49.152511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3428fe-6518-4e27-a351-b0a9f1ef02b9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:49.152946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3428fe-6518-4e27-a351-b0a9f1ef02b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:49.153363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3428fe-6518-4e27-a351-b0a9f1ef02b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:49.171173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e027e-c5bb-4e71-b2fe-320ce3dfd37c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-096e027e-c5bb-4e71-b2fe-320ce3dfd37c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:49.180073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:49.181359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:49.182354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 427/843] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:49.191794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e027e-c5bb-4e71-b2fe-320ce3dfd37c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:49.225297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:49.247262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3428fe-6518-4e27-a351-b0a9f1ef02b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:49.249084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3428fe-6518-4e27-a351-b0a9f1ef02b9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:49.318979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:49.336252 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e027e-c5bb-4e71-b2fe-320ce3dfd37c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:49.369800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 417/844] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:48 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 11:58:49.371348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3d0d5-f650-456d-9b61-3d723249d0ff None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:49.371798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3d0d5-f650-456d-9b61-3d723249d0ff None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:49.372239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3d0d5-f650-456d-9b61-3d723249d0ff None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:49.373914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 418/845] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:49.375612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3d0d5-f650-456d-9b61-3d723249d0ff None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:49.378513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e2d5f-7fc6-480f-8981-7f3509dc37de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:49.379355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2d5f-7fc6-480f-8981-7f3509dc37de None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:49.379720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2d5f-7fc6-480f-8981-7f3509dc37de None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:49.380077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2d5f-7fc6-480f-8981-7f3509dc37de None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:49.381005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e2d5f-7fc6-480f-8981-7f3509dc37de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:49.381324 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e2d5f-7fc6-480f-8981-7f3509dc37de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:49.382803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e2d5f-7fc6-480f-8981-7f3509dc37de None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:49.393830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 428/846] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:49.396288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1683aa-5731-4b77-bcac-2b3ef6093bd7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:49.396288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1683aa-5731-4b77-bcac-2b3ef6093bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:49.396288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1683aa-5731-4b77-bcac-2b3ef6093bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:49.416857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3c1683aa-5731-4b77-bcac-2b3ef6093bd7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:49.419504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3c1683aa-5731-4b77-bcac-2b3ef6093bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:49.502999 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 429/847] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:49.504251 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1683aa-5731-4b77-bcac-2b3ef6093bd7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:49.526119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:49.595119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3d0d5-f650-456d-9b61-3d723249d0ff None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:49.648425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbba84-59d1-4b13-af79-570311da9d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:49.649445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbba84-59d1-4b13-af79-570311da9d17 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:49.649929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbba84-59d1-4b13-af79-570311da9d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:49.650435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbba84-59d1-4b13-af79-570311da9d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:49.659432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1683aa-5731-4b77-bcac-2b3ef6093bd7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:49.665457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbba84-59d1-4b13-af79-570311da9d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:49.667008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbba84-59d1-4b13-af79-570311da9d17 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-12dbba84-59d1-4b13-af79-570311da9d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:49.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:49.691835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:49.692785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:49.692785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:49.692785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:49.696377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 419/848] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:49.699506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbba84-59d1-4b13-af79-570311da9d17 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:49.713826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e27b52-3739-4bd5-8f3a-c4b5e33a406a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:49.714838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:49.715147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e27b52-3739-4bd5-8f3a-c4b5e33a406a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:49.715651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e27b52-3739-4bd5-8f3a-c4b5e33a406a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:49.716130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e27b52-3739-4bd5-8f3a-c4b5e33a406a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:49.729027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e27b52-3739-4bd5-8f3a-c4b5e33a406a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:49.731200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e27b52-3739-4bd5-8f3a-c4b5e33a406a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-d9e27b52-3739-4bd5-8f3a-c4b5e33a406a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:49.747875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:49.748923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:49.749802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:49.749802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:49.749802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:49.756850 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 430/849] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:49.758261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e27b52-3739-4bd5-8f3a-c4b5e33a406a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:49.836905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:49.838444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbba84-59d1-4b13-af79-570311da9d17 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:49.878337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502986-44a9-446b-957a-54c8c99ba55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:49.879388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502986-44a9-446b-957a-54c8c99ba55b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:49.879900 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502986-44a9-446b-957a-54c8c99ba55b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:49.881004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502986-44a9-446b-957a-54c8c99ba55b None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:49.881880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502986-44a9-446b-957a-54c8c99ba55b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:49.882393 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502986-44a9-446b-957a-54c8c99ba55b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:49.884271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502986-44a9-446b-957a-54c8c99ba55b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:49.892648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e27b52-3739-4bd5-8f3a-c4b5e33a406a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:49.900131 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 420/850] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:49.907542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502986-44a9-446b-957a-54c8c99ba55b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:49.946828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e001ae-d31b-44f6-9020-f4e4c4996401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:49.947362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e001ae-d31b-44f6-9020-f4e4c4996401 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:49.947653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e001ae-d31b-44f6-9020-f4e4c4996401 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:49.947914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e001ae-d31b-44f6-9020-f4e4c4996401 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:49.948606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e001ae-d31b-44f6-9020-f4e4c4996401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:49.948909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e001ae-d31b-44f6-9020-f4e4c4996401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:49.951459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e001ae-d31b-44f6-9020-f4e4c4996401 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:49.971377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 431/851] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:49.973053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e001ae-d31b-44f6-9020-f4e4c4996401 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:49.993260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:50.040318 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502986-44a9-446b-957a-54c8c99ba55b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:50.094020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f1352-e5c4-4e5f-a014-9788682d30ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:50.095112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1352-e5c4-4e5f-a014-9788682d30ca None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:50.095603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1352-e5c4-4e5f-a014-9788682d30ca None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:50.096089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1352-e5c4-4e5f-a014-9788682d30ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:50.102064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e001ae-d31b-44f6-9020-f4e4c4996401 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:50.108760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f1352-e5c4-4e5f-a014-9788682d30ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:50.111476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f1352-e5c4-4e5f-a014-9788682d30ca None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:50.127451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-383f1352-e5c4-4e5f-a014-9788682d30ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:50.133950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:50.134839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:50.135747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:50.135747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:50.135747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:50.135747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:50.135747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:50.135747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:50.135747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:50.135747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:50.136954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 421/852] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:50.137754 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f1352-e5c4-4e5f-a014-9788682d30ca None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:50.146629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023051ed-0aae-4bef-a30b-a78a1d0128fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:50.147282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023051ed-0aae-4bef-a30b-a78a1d0128fd None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:50.154014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023051ed-0aae-4bef-a30b-a78a1d0128fd None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:50.154014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023051ed-0aae-4bef-a30b-a78a1d0128fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:50.156116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023051ed-0aae-4bef-a30b-a78a1d0128fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:50.157661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023051ed-0aae-4bef-a30b-a78a1d0128fd None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-023051ed-0aae-4bef-a30b-a78a1d0128fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:50.170985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:50.172003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 432/853] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:58:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:50.178643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023051ed-0aae-4bef-a30b-a78a1d0128fd None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:50.318604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f1352-e5c4-4e5f-a014-9788682d30ca None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:50.355684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023051ed-0aae-4bef-a30b-a78a1d0128fd None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:50.365891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:50.377645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891772-5ccb-45f0-804e-0451dc0b4cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:50.378290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891772-5ccb-45f0-804e-0451dc0b4cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:50.378571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891772-5ccb-45f0-804e-0451dc0b4cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:50.381233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891772-5ccb-45f0-804e-0451dc0b4cd1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:50.381233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a891772-5ccb-45f0-804e-0451dc0b4cd1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:50.381570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a891772-5ccb-45f0-804e-0451dc0b4cd1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9a891772-5ccb-45f0-804e-0451dc0b4cd1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:50.391123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:50.393118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:50.394762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 422/854] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:58:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:50.399412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891772-5ccb-45f0-804e-0451dc0b4cd1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:50.420842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4406b0-dc4a-4a41-afc1-2e0387e7fd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:50.421849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4406b0-dc4a-4a41-afc1-2e0387e7fd84 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:50.422403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4406b0-dc4a-4a41-afc1-2e0387e7fd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:50.422916 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4406b0-dc4a-4a41-afc1-2e0387e7fd84 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:50.424231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4406b0-dc4a-4a41-afc1-2e0387e7fd84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:50.424779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4406b0-dc4a-4a41-afc1-2e0387e7fd84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:50.428136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4406b0-dc4a-4a41-afc1-2e0387e7fd84 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:50.456030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 433/855] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:50.456030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4406b0-dc4a-4a41-afc1-2e0387e7fd84 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:50.528339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:50.541158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891772-5ccb-45f0-804e-0451dc0b4cd1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:50.594744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde618-857e-453b-a05d-5bdb2bcde7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:50.595503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde618-857e-453b-a05d-5bdb2bcde7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:50.596069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde618-857e-453b-a05d-5bdb2bcde7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:50.596269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde618-857e-453b-a05d-5bdb2bcde7f8 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:50.597151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cde618-857e-453b-a05d-5bdb2bcde7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:50.597587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cde618-857e-453b-a05d-5bdb2bcde7f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:50.599991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cde618-857e-453b-a05d-5bdb2bcde7f8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:50.608541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4406b0-dc4a-4a41-afc1-2e0387e7fd84 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:50.623243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 423/856] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Sep 1 11:58:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:50.624251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde618-857e-453b-a05d-5bdb2bcde7f8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:50.669282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a3597-bde8-44d3-931b-49d2585be7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:50.671132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a3597-bde8-44d3-931b-49d2585be7cf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:50.671656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a3597-bde8-44d3-931b-49d2585be7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:50.672275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a3597-bde8-44d3-931b-49d2585be7cf None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:50.673218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a3597-bde8-44d3-931b-49d2585be7cf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:50.673704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a3597-bde8-44d3-931b-49d2585be7cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:50.675463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a3597-bde8-44d3-931b-49d2585be7cf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:50.687871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 434/857] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:58:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:50.690217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a3597-bde8-44d3-931b-49d2585be7cf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:50.722774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:50.816161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde618-857e-453b-a05d-5bdb2bcde7f8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:50.866886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a3597-bde8-44d3-931b-49d2585be7cf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:50.881418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:50.885594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a020d79-7996-47d8-95bc-593f88e43a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:50.886378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a020d79-7996-47d8-95bc-593f88e43a62 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:50.886866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a020d79-7996-47d8-95bc-593f88e43a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:50.887372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a020d79-7996-47d8-95bc-593f88e43a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:50.888801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a020d79-7996-47d8-95bc-593f88e43a62 None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=9b9457f6eebd49e7858158a1706ec99d) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:50.889415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a020d79-7996-47d8-95bc-593f88e43a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:50.892154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a020d79-7996-47d8-95bc-593f88e43a62 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:50.912240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 424/858] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:50 2022] GET /identity/v3/role_assignments?user.id=9b9457f6eebd49e7858158a1706ec99d&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:50.912240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a020d79-7996-47d8-95bc-593f88e43a62 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:50.935272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd1baa-d066-4569-98fb-0595964772bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:50.936544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1baa-d066-4569-98fb-0595964772bc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:50.937050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1baa-d066-4569-98fb-0595964772bc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:50.937549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1baa-d066-4569-98fb-0595964772bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:51.095294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd1baa-d066-4569-98fb-0595964772bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:51.098380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd1baa-d066-4569-98fb-0595964772bc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:51.142437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a020d79-7996-47d8-95bc-593f88e43a62 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:51.181944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:51.218224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172210-1a5a-4abb-ae5c-406053c9dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:51.220017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172210-1a5a-4abb-ae5c-406053c9dffd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:51.220376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172210-1a5a-4abb-ae5c-406053c9dffd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:51.220575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172210-1a5a-4abb-ae5c-406053c9dffd None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:51.221229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba172210-1a5a-4abb-ae5c-406053c9dffd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:51.224325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba172210-1a5a-4abb-ae5c-406053c9dffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:51.224325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba172210-1a5a-4abb-ae5c-406053c9dffd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:51.228725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 425/859] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:58:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:51.287658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 435/860] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:50 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 11:58:51.297271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172210-1a5a-4abb-ae5c-406053c9dffd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:51.373249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d6d7d-81cc-4232-b101-26c7442320f2 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:51.374256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d6d7d-81cc-4232-b101-26c7442320f2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:51.375112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d6d7d-81cc-4232-b101-26c7442320f2 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:51.378786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 436/861] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:51.387102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b035b-d941-4d83-9746-ef96c383c940 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:51.387598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b035b-d941-4d83-9746-ef96c383c940 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:51.388064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b035b-d941-4d83-9746-ef96c383c940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:51.410353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:51.423740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-cd3b035b-d941-4d83-9746-ef96c383c940 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:51.424763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172210-1a5a-4abb-ae5c-406053c9dffd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:51.429628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cd3b035b-d941-4d83-9746-ef96c383c940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:51.477408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae8b4e-d475-48d9-b3f6-154e0e5daf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:51.479009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae8b4e-d475-48d9-b3f6-154e0e5daf62 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:51.482995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae8b4e-d475-48d9-b3f6-154e0e5daf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:51.482995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae8b4e-d475-48d9-b3f6-154e0e5daf62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:51.500815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae8b4e-d475-48d9-b3f6-154e0e5daf62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:51.503517 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae8b4e-d475-48d9-b3f6-154e0e5daf62 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-89ae8b4e-d475-48d9-b3f6-154e0e5daf62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:51.530737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:51.531735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:51.532664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:51.532664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:51.532664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:51.540617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 426/862] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:51.542273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae8b4e-d475-48d9-b3f6-154e0e5daf62 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:51.549907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 437/863] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:51.600314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:51.736630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae8b4e-d475-48d9-b3f6-154e0e5daf62 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:51.778265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fd5db-d0e8-4c75-b1ac-23fe2416c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:51.778902 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fd5db-d0e8-4c75-b1ac-23fe2416c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:51.779177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fd5db-d0e8-4c75-b1ac-23fe2416c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:51.779457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fd5db-d0e8-4c75-b1ac-23fe2416c1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:51.780133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fd5db-d0e8-4c75-b1ac-23fe2416c1a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:51.780477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fd5db-d0e8-4c75-b1ac-23fe2416c1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:51.781912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fd5db-d0e8-4c75-b1ac-23fe2416c1a2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:51.797011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 427/864] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:51.809426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b035b-d941-4d83-9746-ef96c383c940 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:51.866337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fd5db-d0e8-4c75-b1ac-23fe2416c1a2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:51.931298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b035b-d941-4d83-9746-ef96c383c940 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:51.970709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e216d-e30d-497d-a088-1351bc5f23e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:51.971346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e216d-e30d-497d-a088-1351bc5f23e9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:51.971636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e216d-e30d-497d-a088-1351bc5f23e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:51.971911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e216d-e30d-497d-a088-1351bc5f23e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:51.975805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:51.980577 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e216d-e30d-497d-a088-1351bc5f23e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:51.982422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e216d-e30d-497d-a088-1351bc5f23e9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-181e216d-e30d-497d-a088-1351bc5f23e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:51.995481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:51.996647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:51.997756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:51.997756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:51.997756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:51.997756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:51.997756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:51.997756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:51.997756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:51.997756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:51.999691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 438/865] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:52.000902 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fd5db-d0e8-4c75-b1ac-23fe2416c1a2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:52.004305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:52.011067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e216d-e30d-497d-a088-1351bc5f23e9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:52.047566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb5ee2-5565-476f-a9b8-eee1d2e7c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:52.048241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb5ee2-5565-476f-a9b8-eee1d2e7c556 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:52.048544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb5ee2-5565-476f-a9b8-eee1d2e7c556 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:52.048856 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb5ee2-5565-476f-a9b8-eee1d2e7c556 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:52.049456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb5ee2-5565-476f-a9b8-eee1d2e7c556 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:52.050848 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb5ee2-5565-476f-a9b8-eee1d2e7c556 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8fbb5ee2-5565-476f-a9b8-eee1d2e7c556 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:52.060272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:52.062402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 11:58:52.064496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:52.066993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 428/866] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Sep 1 11:58:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:52.068288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb5ee2-5565-476f-a9b8-eee1d2e7c556 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:52.143662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e216d-e30d-497d-a088-1351bc5f23e9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:52.187895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca95f1-1389-4618-8785-440c7c4c3f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:52.188591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca95f1-1389-4618-8785-440c7c4c3f9c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:52.188871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca95f1-1389-4618-8785-440c7c4c3f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:52.189149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca95f1-1389-4618-8785-440c7c4c3f9c None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:52.189894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca95f1-1389-4618-8785-440c7c4c3f9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:52.190183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca95f1-1389-4618-8785-440c7c4c3f9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:52.192009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca95f1-1389-4618-8785-440c7c4c3f9c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:52.198962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb5ee2-5565-476f-a9b8-eee1d2e7c556 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:52.205902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 439/867] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:52.216339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca95f1-1389-4618-8785-440c7c4c3f9c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:52.257714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6a123-8424-4382-9e47-83f2769f27b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:52.259419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6a123-8424-4382-9e47-83f2769f27b8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:52.259419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6a123-8424-4382-9e47-83f2769f27b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:52.259732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6a123-8424-4382-9e47-83f2769f27b8 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:52.260932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6a123-8424-4382-9e47-83f2769f27b8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:52.261543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6a123-8424-4382-9e47-83f2769f27b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:52.264063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6a123-8424-4382-9e47-83f2769f27b8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:52.277969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 429/868] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:58:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:52.280027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6a123-8424-4382-9e47-83f2769f27b8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:52.302748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:52.304901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:52.388681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca95f1-1389-4618-8785-440c7c4c3f9c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:52.402743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6a123-8424-4382-9e47-83f2769f27b8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:52.454130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220531f-fabe-4d31-aa00-834b7f87b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:52.454929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220531f-fabe-4d31-aa00-834b7f87b637 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:52.455219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220531f-fabe-4d31-aa00-834b7f87b637 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:52.455600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220531f-fabe-4d31-aa00-834b7f87b637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:52.456486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220531f-fabe-4d31-aa00-834b7f87b637 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=8a59a4732ec14a838be9c838dbeb7fd0) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:52.456806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220531f-fabe-4d31-aa00-834b7f87b637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:52.457385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dae57c-5b96-42e6-a1e2-4799d134f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:52.458355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220531f-fabe-4d31-aa00-834b7f87b637 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:52.458959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dae57c-5b96-42e6-a1e2-4799d134f8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:52.459452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dae57c-5b96-42e6-a1e2-4799d134f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:52.459928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dae57c-5b96-42e6-a1e2-4799d134f8f9 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:52.461253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dae57c-5b96-42e6-a1e2-4799d134f8f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:52.461850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dae57c-5b96-42e6-a1e2-4799d134f8f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:52.464615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dae57c-5b96-42e6-a1e2-4799d134f8f9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:52.466241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 440/869] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:52 2022] GET /identity/v3/role_assignments?user.id=8a59a4732ec14a838be9c838dbeb7fd0&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:52.482176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 430/870] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:58:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:53.321276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f8ee-371c-4ea5-b2b4-b6478aa0aab7 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:53.321709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f8ee-371c-4ea5-b2b4-b6478aa0aab7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:53.321816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f8ee-371c-4ea5-b2b4-b6478aa0aab7 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:53.323624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 441/871] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:58:53.329594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fe6f8-40fd-4eb8-bc39-f18fd02032fc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:53.330247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fe6f8-40fd-4eb8-bc39-f18fd02032fc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:53.330247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fe6f8-40fd-4eb8-bc39-f18fd02032fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:53.351347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-910fe6f8-40fd-4eb8-bc39-f18fd02032fc None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:53.352575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-910fe6f8-40fd-4eb8-bc39-f18fd02032fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:53.428429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 431/872] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:58:53.698368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f8ee-371c-4ea5-b2b4-b6478aa0aab7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:53.816245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f8ee-371c-4ea5-b2b4-b6478aa0aab7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:53.840384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:53.856817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d22f0-c54e-4c73-85e0-a5e8a50aa432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:53.857890 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d22f0-c54e-4c73-85e0-a5e8a50aa432 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:53.858358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d22f0-c54e-4c73-85e0-a5e8a50aa432 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:53.858815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d22f0-c54e-4c73-85e0-a5e8a50aa432 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:53.859664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d22f0-c54e-4c73-85e0-a5e8a50aa432 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:53.861354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d22f0-c54e-4c73-85e0-a5e8a50aa432 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:53.876310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d979b-34cf-4770-bb98-45cd6e9f2c76 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:53.876905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d979b-34cf-4770-bb98-45cd6e9f2c76 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:53.877242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d979b-34cf-4770-bb98-45cd6e9f2c76 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:53.878888 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 432/873] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:53.884824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ddc65-6101-4783-b5c4-2dad9bfd5949 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:53.885104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ddc65-6101-4783-b5c4-2dad9bfd5949 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:53.887171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ddc65-6101-4783-b5c4-2dad9bfd5949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:53.906238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3e4ddc65-6101-4783-b5c4-2dad9bfd5949 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:53.907591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3e4ddc65-6101-4783-b5c4-2dad9bfd5949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:53.918352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:53.998305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 442/874] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:58:53 2022] POST /identity/v3/services => generated 251 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:58:53.999097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 433/875] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:58:54.500772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d22f0-c54e-4c73-85e0-a5e8a50aa432 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:54.706249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d22f0-c54e-4c73-85e0-a5e8a50aa432 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:54.777538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92740dab-76af-40c5-96a9-8b4a5ad79279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:54.778519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92740dab-76af-40c5-96a9-8b4a5ad79279 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:54.779025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92740dab-76af-40c5-96a9-8b4a5ad79279 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:54.779505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92740dab-76af-40c5-96a9-8b4a5ad79279 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:54.800353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92740dab-76af-40c5-96a9-8b4a5ad79279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-92740dab-76af-40c5-96a9-8b4a5ad79279 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:58:54.810501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:54.815158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:54.816821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 443/876] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 1 11:58:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:54.822501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ddc65-6101-4783-b5c4-2dad9bfd5949 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:54.873402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274818c-c188-4182-b75a-1f576328b7a7 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:54.873666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274818c-c188-4182-b75a-1f576328b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:54.873959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274818c-c188-4182-b75a-1f576328b7a7 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:54.875665 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 444/877] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:58:54.882123 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec01a-87a4-429c-9b12-e0be1b357458 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:54.882416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec01a-87a4-429c-9b12-e0be1b357458 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:54.882670 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec01a-87a4-429c-9b12-e0be1b357458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:54.903145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-606ec01a-87a4-429c-9b12-e0be1b357458 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:54.904500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-606ec01a-87a4-429c-9b12-e0be1b357458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:54.940652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:55.006067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 445/878] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:54 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:58:55.026017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ddc65-6101-4783-b5c4-2dad9bfd5949 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:55.069157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64482d3b-e626-4789-8a6b-b74012a74286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:55.069679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482d3b-e626-4789-8a6b-b74012a74286 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:55.069963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482d3b-e626-4789-8a6b-b74012a74286 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:55.070236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64482d3b-e626-4789-8a6b-b74012a74286 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:55.070932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64482d3b-e626-4789-8a6b-b74012a74286 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:55.071236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64482d3b-e626-4789-8a6b-b74012a74286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:55.072679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64482d3b-e626-4789-8a6b-b74012a74286 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:55.082548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 434/879] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 1 11:58:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:55.091835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec01a-87a4-429c-9b12-e0be1b357458 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:55.231996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec01a-87a4-429c-9b12-e0be1b357458 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:55.297149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf33128-fc3a-42b3-ad3f-85dde0268bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:55.297810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33128-fc3a-42b3-ad3f-85dde0268bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:55.298090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33128-fc3a-42b3-ad3f-85dde0268bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:55.298365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33128-fc3a-42b3-ad3f-85dde0268bd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:55.310410 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf33128-fc3a-42b3-ad3f-85dde0268bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:55.311957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf33128-fc3a-42b3-ad3f-85dde0268bd6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-2bf33128-fc3a-42b3-ad3f-85dde0268bd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:55.328097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:55.330004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:55.331869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:55.331869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:55.331869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:55.331869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 446/880] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:55.345080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64482d3b-e626-4789-8a6b-b74012a74286 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:55.355869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:55.361362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf33128-fc3a-42b3-ad3f-85dde0268bd6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:55.387401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:55.481214 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf33128-fc3a-42b3-ad3f-85dde0268bd6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:55.519772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64482d3b-e626-4789-8a6b-b74012a74286 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:55.548548 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0212358-3824-49c9-8b23-d40c0b74236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:55.549170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0212358-3824-49c9-8b23-d40c0b74236c None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:55.549464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0212358-3824-49c9-8b23-d40c0b74236c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:55.549736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0212358-3824-49c9-8b23-d40c0b74236c None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:55.550578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0212358-3824-49c9-8b23-d40c0b74236c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:55.553096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0212358-3824-49c9-8b23-d40c0b74236c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:55.589692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d15cc2-825e-4804-9133-6aad3b1f5494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:55.590657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15cc2-825e-4804-9133-6aad3b1f5494 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:55.591123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15cc2-825e-4804-9133-6aad3b1f5494 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:55.591592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15cc2-825e-4804-9133-6aad3b1f5494 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:55.592770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d15cc2-825e-4804-9133-6aad3b1f5494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:55.593298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d15cc2-825e-4804-9133-6aad3b1f5494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:55.595833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d15cc2-825e-4804-9133-6aad3b1f5494 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:55.623119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 435/881] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:55.623119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae33933-5391-4486-9234-95cbeb7d5bd1 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:55.623119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae33933-5391-4486-9234-95cbeb7d5bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:55.623119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae33933-5391-4486-9234-95cbeb7d5bd1 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:55.623975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 436/882] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:55.625411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae33933-5391-4486-9234-95cbeb7d5bd1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:55.637777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 447/883] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:58:55 2022] POST /identity/v3/services => generated 269 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 11:58:55.640569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094a5a9-2082-4dab-8923-a5d5803bb0b9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:55.641448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094a5a9-2082-4dab-8923-a5d5803bb0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:55.642211 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094a5a9-2082-4dab-8923-a5d5803bb0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:55.674730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3094a5a9-2082-4dab-8923-a5d5803bb0b9 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:55.677296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3094a5a9-2082-4dab-8923-a5d5803bb0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:55.779223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:55.810953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 448/884] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:55.865066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae33933-5391-4486-9234-95cbeb7d5bd1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:55.932962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac8026-0ebb-4632-bd47-fae73523b1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:55.933925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8026-0ebb-4632-bd47-fae73523b1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:55.934389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8026-0ebb-4632-bd47-fae73523b1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:55.934858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8026-0ebb-4632-bd47-fae73523b1b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:55.950164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac8026-0ebb-4632-bd47-fae73523b1b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:55.952830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac8026-0ebb-4632-bd47-fae73523b1b3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-97ac8026-0ebb-4632-bd47-fae73523b1b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:58:55.976163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:55.977289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:55.978434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:55.978434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:55.978434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:58:55.978434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:58:55.978434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:58:55.978434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:58:55.978434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:58:55.978434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:58:55.978434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:58:55.978434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:55.979656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 437/885] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 1 11:58:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:55.985907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094a5a9-2082-4dab-8923-a5d5803bb0b9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:55.992841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:56.117597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094a5a9-2082-4dab-8923-a5d5803bb0b9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:56.145126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac8026-0ebb-4632-bd47-fae73523b1b3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:56.184136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d1982-40f8-4cf5-ba80-5491004a35ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:56.185363 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d1982-40f8-4cf5-ba80-5491004a35ca None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:56.186154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d1982-40f8-4cf5-ba80-5491004a35ca None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:56.186952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d1982-40f8-4cf5-ba80-5491004a35ca None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:56.188727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d1982-40f8-4cf5-ba80-5491004a35ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:56.189657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d1982-40f8-4cf5-ba80-5491004a35ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:56.192868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d1982-40f8-4cf5-ba80-5491004a35ca None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:56.231942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 449/886] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 1 11:58:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:56.242416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d1982-40f8-4cf5-ba80-5491004a35ca None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:56.267233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac8026-0ebb-4632-bd47-fae73523b1b3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:56.296837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:56.311563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740675bc-7b9c-450c-9ed8-434fa7dbaca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:56.312349 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740675bc-7b9c-450c-9ed8-434fa7dbaca8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:56.312629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740675bc-7b9c-450c-9ed8-434fa7dbaca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:56.312910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740675bc-7b9c-450c-9ed8-434fa7dbaca8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:56.313548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740675bc-7b9c-450c-9ed8-434fa7dbaca8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:56.314936 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740675bc-7b9c-450c-9ed8-434fa7dbaca8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-740675bc-7b9c-450c-9ed8-434fa7dbaca8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:56.326288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:56.328980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:56.330507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 438/887] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:58:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:56.331995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956db32-a9d1-49e4-8fec-b97bb87962c5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:56.331995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956db32-a9d1-49e4-8fec-b97bb87962c5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:56.331995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956db32-a9d1-49e4-8fec-b97bb87962c5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:56.331995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 439/888] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:56.334698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956db32-a9d1-49e4-8fec-b97bb87962c5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:56.352937 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:56.404293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d1982-40f8-4cf5-ba80-5491004a35ca None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:56.466044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86156349-c6e4-42bf-a5b3-951664604c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:56.466871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86156349-c6e4-42bf-a5b3-951664604c5d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:56.467341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86156349-c6e4-42bf-a5b3-951664604c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:56.467806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86156349-c6e4-42bf-a5b3-951664604c5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:56.519747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956db32-a9d1-49e4-8fec-b97bb87962c5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:56.564817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02973a0a-6664-4700-be42-1754c9aebdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:56.565444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02973a0a-6664-4700-be42-1754c9aebdff None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:56.565731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02973a0a-6664-4700-be42-1754c9aebdff None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:56.566150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02973a0a-6664-4700-be42-1754c9aebdff None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:56.566639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02973a0a-6664-4700-be42-1754c9aebdff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:56.566993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02973a0a-6664-4700-be42-1754c9aebdff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:56.568698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02973a0a-6664-4700-be42-1754c9aebdff None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:56.577990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 440/889] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 1 11:58:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:56.577990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eea74-2898-48ae-bc16-fb62b88d92fa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:56.577990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eea74-2898-48ae-bc16-fb62b88d92fa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:56.577990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eea74-2898-48ae-bc16-fb62b88d92fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:56.602169 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86156349-c6e4-42bf-a5b3-951664604c5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:56.604497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86156349-c6e4-42bf-a5b3-951664604c5d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:56.607561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c90eea74-2898-48ae-bc16-fb62b88d92fa None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:56.610512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c90eea74-2898-48ae-bc16-fb62b88d92fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:56.700266 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:56.721907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:56.734900 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 441/890] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:58:56.748928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eea74-2898-48ae-bc16-fb62b88d92fa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:56.804427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 450/891] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:58:56 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 11:58:56.809487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86156349-c6e4-42bf-a5b3-951664604c5d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:56.967131 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eea74-2898-48ae-bc16-fb62b88d92fa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:57.010820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86156349-c6e4-42bf-a5b3-951664604c5d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:57.011993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410cf2b-7926-4f41-8a37-38be14545b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:57.013164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410cf2b-7926-4f41-8a37-38be14545b06 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:57.013717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410cf2b-7926-4f41-8a37-38be14545b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:57.014308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410cf2b-7926-4f41-8a37-38be14545b06 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:57.015343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410cf2b-7926-4f41-8a37-38be14545b06 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:57.015869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410cf2b-7926-4f41-8a37-38be14545b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:57.017974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410cf2b-7926-4f41-8a37-38be14545b06 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:57.025165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 442/892] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 1 11:58:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:57.053271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5f7e0-7c68-48d0-b935-1f05832e6d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:57.053932 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f7e0-7c68-48d0-b935-1f05832e6d06 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:57.054207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f7e0-7c68-48d0-b935-1f05832e6d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:57.054478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f7e0-7c68-48d0-b935-1f05832e6d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:57.068399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5f7e0-7c68-48d0-b935-1f05832e6d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:57.069888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5f7e0-7c68-48d0-b935-1f05832e6d06 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6de5f7e0-7c68-48d0-b935-1f05832e6d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:58:57.088681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:57.090272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:58:57.091615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:58:57.091615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:58:57.091615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:57.091615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 451/893] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:57.097438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410cf2b-7926-4f41-8a37-38be14545b06 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:57.156982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:57.182960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5f7e0-7c68-48d0-b935-1f05832e6d06 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:57.205241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:57.222950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410cf2b-7926-4f41-8a37-38be14545b06 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:57.275470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043de094-f18a-420f-9c67-4699d59cd2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:57.276109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043de094-f18a-420f-9c67-4699d59cd2dd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:57.276413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043de094-f18a-420f-9c67-4699d59cd2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:57.276698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043de094-f18a-420f-9c67-4699d59cd2dd None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:57.277399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043de094-f18a-420f-9c67-4699d59cd2dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:57.277713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043de094-f18a-420f-9c67-4699d59cd2dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:57.279096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043de094-f18a-420f-9c67-4699d59cd2dd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:57.295264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 443/894] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:57.301016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043de094-f18a-420f-9c67-4699d59cd2dd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:57.377334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5f7e0-7c68-48d0-b935-1f05832e6d06 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:57.441469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043de094-f18a-420f-9c67-4699d59cd2dd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:57.449994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c540c-60cb-47af-8ff7-61d822d35b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:57.452699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c540c-60cb-47af-8ff7-61d822d35b6f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:57.453991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:57.455246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c540c-60cb-47af-8ff7-61d822d35b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:57.456523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c540c-60cb-47af-8ff7-61d822d35b6f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:57.458706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c540c-60cb-47af-8ff7-61d822d35b6f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:57.462556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c540c-60cb-47af-8ff7-61d822d35b6f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-da7c540c-60cb-47af-8ff7-61d822d35b6f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:57.484042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:57.485898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 11:58:57.487465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:58:57.488982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1565ffb-2c67-4200-8030-17ae05bc7cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:57.488982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1565ffb-2c67-4200-8030-17ae05bc7cfc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:57.488982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1565ffb-2c67-4200-8030-17ae05bc7cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:57.488982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1565ffb-2c67-4200-8030-17ae05bc7cfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:57.490689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 452/895] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:58:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:57.499640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c540c-60cb-47af-8ff7-61d822d35b6f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:57.504726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1565ffb-2c67-4200-8030-17ae05bc7cfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:57.509443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1565ffb-2c67-4200-8030-17ae05bc7cfc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d1565ffb-2c67-4200-8030-17ae05bc7cfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:58:57.535496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:57.537313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:57.539053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:58:57.539053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:58:57.539053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:58:57.539053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:58:57.539053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:58:57.539053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:58:57.539053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:58:57.539053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:57.543885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 444/896] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:58:57.550768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1565ffb-2c67-4200-8030-17ae05bc7cfc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:57.684765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:57.707420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1565ffb-2c67-4200-8030-17ae05bc7cfc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:57.715947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c540c-60cb-47af-8ff7-61d822d35b6f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:57.758558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bad471-f716-4504-a0b2-fef1bfc57b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:57.759088 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bad471-f716-4504-a0b2-fef1bfc57b2f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:57.759369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bad471-f716-4504-a0b2-fef1bfc57b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:57.759650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bad471-f716-4504-a0b2-fef1bfc57b2f None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:57.760823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bad471-f716-4504-a0b2-fef1bfc57b2f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:57.760823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bad471-f716-4504-a0b2-fef1bfc57b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:57.762118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bad471-f716-4504-a0b2-fef1bfc57b2f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:57.768040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 453/897] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:58:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:57.777767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bad471-f716-4504-a0b2-fef1bfc57b2f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:57.797061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a5837-09c4-402b-99d2-8168d66e4b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:57.798041 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5837-09c4-402b-99d2-8168d66e4b16 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:57.798590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5837-09c4-402b-99d2-8168d66e4b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:57.799072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5837-09c4-402b-99d2-8168d66e4b16 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:57.800575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a5837-09c4-402b-99d2-8168d66e4b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:57.801121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a5837-09c4-402b-99d2-8168d66e4b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:57.804414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a5837-09c4-402b-99d2-8168d66e4b16 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:57.829570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 445/898] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:57.837639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a5837-09c4-402b-99d2-8168d66e4b16 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:57.883288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:57.992265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bad471-f716-4504-a0b2-fef1bfc57b2f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:58.026610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a5837-09c4-402b-99d2-8168d66e4b16 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:58.068422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d693941-feaa-4f4f-a140-427386d34498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:58.069289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b69f87-a737-4032-9269-6b10a335541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:58.069471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d693941-feaa-4f4f-a140-427386d34498 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:58.069471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d693941-feaa-4f4f-a140-427386d34498 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:58.069723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d693941-feaa-4f4f-a140-427386d34498 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:58.070128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b69f87-a737-4032-9269-6b10a335541a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:58.070291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d693941-feaa-4f4f-a140-427386d34498 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:58.070436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b69f87-a737-4032-9269-6b10a335541a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:58.070574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d693941-feaa-4f4f-a140-427386d34498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:58.070883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b69f87-a737-4032-9269-6b10a335541a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:58.071920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d693941-feaa-4f4f-a140-427386d34498 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:58.072245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b69f87-a737-4032-9269-6b10a335541a None admin] RBAC: Adding query filter params (role.id=66ad504049f14c468b41216dbc3285a4, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=9b9457f6eebd49e7858158a1706ec99d) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:58.072782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b69f87-a737-4032-9269-6b10a335541a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:58.076388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b69f87-a737-4032-9269-6b10a335541a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:58.078074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 454/899] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:58:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:58.078998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08cfea-e514-4316-af50-8edf4c57d865 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:58.079424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08cfea-e514-4316-af50-8edf4c57d865 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:58.079616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08cfea-e514-4316-af50-8edf4c57d865 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:58.081083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 455/900] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:58.086987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622afb36-be0d-40fe-8290-40c333eabded None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:58.087364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622afb36-be0d-40fe-8290-40c333eabded None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:58.087518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622afb36-be0d-40fe-8290-40c333eabded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:58.095879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 446/901] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:58:57 2022] GET /identity/v3/role_assignments?user.id=9b9457f6eebd49e7858158a1706ec99d&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=66ad504049f14c468b41216dbc3285a4 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:58.097361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b69f87-a737-4032-9269-6b10a335541a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:58.117554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:58.125825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-622afb36-be0d-40fe-8290-40c333eabded None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:58.128094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-622afb36-be0d-40fe-8290-40c333eabded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:58.275922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 456/902] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:58:58.294986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:58.312013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b69f87-a737-4032-9269-6b10a335541a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:58.355934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec673896-49a3-415f-bb38-2606cfe9a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:58.356634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673896-49a3-415f-bb38-2606cfe9a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:58.357029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673896-49a3-415f-bb38-2606cfe9a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:58.357302 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673896-49a3-415f-bb38-2606cfe9a3d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:58.358103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec673896-49a3-415f-bb38-2606cfe9a3d5 None admin] RBAC: Adding query filter params (interface=public, service_id=6907e7b6ee2a416e88992ba204c3ccc4, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:58.358411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec673896-49a3-415f-bb38-2606cfe9a3d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:58.359959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec673896-49a3-415f-bb38-2606cfe9a3d5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:58.367095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 447/903] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 1 11:58:58 2022] GET /identity/v3/endpoints?service_id=6907e7b6ee2a416e88992ba204c3ccc4&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:58.372900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622afb36-be0d-40fe-8290-40c333eabded None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:58.529557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622afb36-be0d-40fe-8290-40c333eabded None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:58.574926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec673896-49a3-415f-bb38-2606cfe9a3d5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:58.592038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8945-5a21-4667-a5e5-55102543ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:58.593117 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8945-5a21-4667-a5e5-55102543ce4b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:58.593638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8945-5a21-4667-a5e5-55102543ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:58.594095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8945-5a21-4667-a5e5-55102543ce4b None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:58.594917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e8945-5a21-4667-a5e5-55102543ce4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:58.597545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e8945-5a21-4667-a5e5-55102543ce4b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:58.600652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:58.612288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 457/904] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 1 11:58:58 2022] GET /identity/v3/services => generated 1268 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 11:58:58.705545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec673896-49a3-415f-bb38-2606cfe9a3d5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:58.748264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf769720-a004-4bca-ac94-b293e0743795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:58.749186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769720-a004-4bca-ac94-b293e0743795 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:58.749658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769720-a004-4bca-ac94-b293e0743795 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:58.750086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769720-a004-4bca-ac94-b293e0743795 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:58.750975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf769720-a004-4bca-ac94-b293e0743795 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:58.752750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf769720-a004-4bca-ac94-b293e0743795 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-bf769720-a004-4bca-ac94-b293e0743795 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:58:58.763277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:58:58.764542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 11:58:58.765652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:58:58.768264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 448/905] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Sep 1 11:58:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:58:58.777179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8945-5a21-4667-a5e5-55102543ce4b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:58.915462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8945-5a21-4667-a5e5-55102543ce4b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:58.985346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795e72b-b863-47ec-83ff-a61f6f944a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:58.986465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795e72b-b863-47ec-83ff-a61f6f944a9e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:58.986938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795e72b-b863-47ec-83ff-a61f6f944a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:58.987438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795e72b-b863-47ec-83ff-a61f6f944a9e None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:58.988778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795e72b-b863-47ec-83ff-a61f6f944a9e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:58.989991 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795e72b-b863-47ec-83ff-a61f6f944a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:58.992674 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795e72b-b863-47ec-83ff-a61f6f944a9e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:59.002852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 458/906] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:58:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:58:59.008714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf769720-a004-4bca-ac94-b293e0743795 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:59.037505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:59.125856 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf769720-a004-4bca-ac94-b293e0743795 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:59.163910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86949cd8-ee45-4c05-9e0f-3037cc4d5558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:59.164842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86949cd8-ee45-4c05-9e0f-3037cc4d5558 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:59.165269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86949cd8-ee45-4c05-9e0f-3037cc4d5558 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:59.165760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86949cd8-ee45-4c05-9e0f-3037cc4d5558 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:59.166567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86949cd8-ee45-4c05-9e0f-3037cc4d5558 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:59.167025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86949cd8-ee45-4c05-9e0f-3037cc4d5558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:59.168645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86949cd8-ee45-4c05-9e0f-3037cc4d5558 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:59.175189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 449/907] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:58:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:59.181481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795e72b-b863-47ec-83ff-a61f6f944a9e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:59.291489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:59.340955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795e72b-b863-47ec-83ff-a61f6f944a9e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:59.380987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f20ec-ca32-40bf-8b67-6decee0da561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:59.381986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f20ec-ca32-40bf-8b67-6decee0da561 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:59.382544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f20ec-ca32-40bf-8b67-6decee0da561 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:59.383017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f20ec-ca32-40bf-8b67-6decee0da561 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:59.383991 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f20ec-ca32-40bf-8b67-6decee0da561 None admin] RBAC: Adding query filter params (interface=public, service_id=257cec06a9bf4ebebc1f330ab2f6eac9, region_id=RegionOne) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:58:59.384546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f20ec-ca32-40bf-8b67-6decee0da561 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:59.386189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f20ec-ca32-40bf-8b67-6decee0da561 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:59.393353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 459/908] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 1 11:58:59 2022] GET /identity/v3/endpoints?service_id=257cec06a9bf4ebebc1f330ab2f6eac9&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:58:59.400032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86949cd8-ee45-4c05-9e0f-3037cc4d5558 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:58:59.530132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:58:59.565268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86949cd8-ee45-4c05-9e0f-3037cc4d5558 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:58:59.629127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e05d40-3b7d-4b41-b3f7-cec6b39de6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:58:59.631252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e05d40-3b7d-4b41-b3f7-cec6b39de6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:59.631871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e05d40-3b7d-4b41-b3f7-cec6b39de6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:59.632784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e05d40-3b7d-4b41-b3f7-cec6b39de6c9 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:59.634400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e05d40-3b7d-4b41-b3f7-cec6b39de6c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:58:59.637228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e05d40-3b7d-4b41-b3f7-cec6b39de6c9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:58:59.650313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 450/909] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 1 11:58:59 2022] GET /identity/v3/services => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 11:58:59.693138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd0bba-a894-4a79-9bfd-b4c9d74a0553 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:59.693989 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd0bba-a894-4a79-9bfd-b4c9d74a0553 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:59.694766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd0bba-a894-4a79-9bfd-b4c9d74a0553 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:59.698067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 460/910] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:58:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:58:59.703491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb30d-c270-4bf5-ae50-c83890311d24 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:58:59.703868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb30d-c270-4bf5-ae50-c83890311d24 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:58:59.704071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb30d-c270-4bf5-ae50-c83890311d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:58:59.724539 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1cbcb30d-c270-4bf5-ae50-c83890311d24 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:58:59.725776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1cbcb30d-c270-4bf5-ae50-c83890311d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:58:59.804907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 451/911] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:58:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:00.275213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd0bba-a894-4a79-9bfd-b4c9d74a0553 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:00.425098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd0bba-a894-4a79-9bfd-b4c9d74a0553 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:00.451751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb46b-d6d3-4f1a-a20a-2dbf0d5b52a6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:00.452332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb46b-d6d3-4f1a-a20a-2dbf0d5b52a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:00.452415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb46b-d6d3-4f1a-a20a-2dbf0d5b52a6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:00.454049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 452/912] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:00.458910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:00.460273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd5ce-5a5a-4516-8e9c-a8989c01fd7a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:00.460751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd5ce-5a5a-4516-8e9c-a8989c01fd7a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:00.461028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd5ce-5a5a-4516-8e9c-a8989c01fd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:00.468121 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec222c5-1ef2-4688-ba4f-ba71d1dd85e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:00.469415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec222c5-1ef2-4688-ba4f-ba71d1dd85e8 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:00.470828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec222c5-1ef2-4688-ba4f-ba71d1dd85e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:00.471343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec222c5-1ef2-4688-ba4f-ba71d1dd85e8 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:00.472264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec222c5-1ef2-4688-ba4f-ba71d1dd85e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:00.473914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec222c5-1ef2-4688-ba4f-ba71d1dd85e8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:00.483533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a23cd5ce-5a5a-4516-8e9c-a8989c01fd7a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:00.484900 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a23cd5ce-5a5a-4516-8e9c-a8989c01fd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:00.561984 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 453/913] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:00.583615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 461/914] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:59:00 2022] POST /identity/v3/services => generated 241 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:59:00.933674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd5ce-5a5a-4516-8e9c-a8989c01fd7a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:00.948711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:01.115173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b45b57-2cfa-434e-acb7-3a2a505d5001 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:01.116256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b45b57-2cfa-434e-acb7-3a2a505d5001 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:01.116256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b45b57-2cfa-434e-acb7-3a2a505d5001 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:01.118759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd5ce-5a5a-4516-8e9c-a8989c01fd7a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:01.119098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 462/915] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:01.129019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe933e9-6343-4988-a525-a90cd4b00c49 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:01.130232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe933e9-6343-4988-a525-a90cd4b00c49 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:01.130840 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe933e9-6343-4988-a525-a90cd4b00c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:01.162464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ffe933e9-6343-4988-a525-a90cd4b00c49 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:01.164888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ffe933e9-6343-4988-a525-a90cd4b00c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:01.172779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead9dbb-ef05-4c12-b5da-e51e7322c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:01.173684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9dbb-ef05-4c12-b5da-e51e7322c262 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:01.174111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9dbb-ef05-4c12-b5da-e51e7322c262 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:01.174586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9dbb-ef05-4c12-b5da-e51e7322c262 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:01.189985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead9dbb-ef05-4c12-b5da-e51e7322c262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8ead9dbb-ef05-4c12-b5da-e51e7322c262 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:59:01.196985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:01.198149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:59:01.199197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:01.201733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 454/916] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 1 11:59:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:01.210427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead9dbb-ef05-4c12-b5da-e51e7322c262 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:01.276371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 463/917] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:01.313967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:01.358030 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead9dbb-ef05-4c12-b5da-e51e7322c262 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:01.397615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e7bf1-f394-4a1f-a76f-84ecb949c654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:01.398631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e7bf1-f394-4a1f-a76f-84ecb949c654 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:01.399175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e7bf1-f394-4a1f-a76f-84ecb949c654 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:01.399669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e7bf1-f394-4a1f-a76f-84ecb949c654 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:01.400636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e7bf1-f394-4a1f-a76f-84ecb949c654 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:01.401166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e7bf1-f394-4a1f-a76f-84ecb949c654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:01.402750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e7bf1-f394-4a1f-a76f-84ecb949c654 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:01.416637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 455/918] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 1 11:59:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:01.419709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe933e9-6343-4988-a525-a90cd4b00c49 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:01.533006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe933e9-6343-4988-a525-a90cd4b00c49 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:01.553574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:01.573652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f14d0-72cb-4c70-a93e-28357a92d9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:01.574840 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f14d0-72cb-4c70-a93e-28357a92d9ba None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:01.575353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f14d0-72cb-4c70-a93e-28357a92d9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:01.575838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f14d0-72cb-4c70-a93e-28357a92d9ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:01.588547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f14d0-72cb-4c70-a93e-28357a92d9ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:01.590428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f14d0-72cb-4c70-a93e-28357a92d9ba None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-9b9f14d0-72cb-4c70-a93e-28357a92d9ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:01.607868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:01.608905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:01.609813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:01.609813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:01.609813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:01.611933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 464/919] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:01.618567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e7bf1-f394-4a1f-a76f-84ecb949c654 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:01.733077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e7bf1-f394-4a1f-a76f-84ecb949c654 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:01.759899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:01.771691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5fa6-6fd1-4302-a8ff-56d8f18d8ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:01.772344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5fa6-6fd1-4302-a8ff-56d8f18d8ecc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:01.772625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5fa6-6fd1-4302-a8ff-56d8f18d8ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:01.772892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5fa6-6fd1-4302-a8ff-56d8f18d8ecc None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:01.773552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5fa6-6fd1-4302-a8ff-56d8f18d8ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:01.773880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5fa6-6fd1-4302-a8ff-56d8f18d8ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:01.775281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5fa6-6fd1-4302-a8ff-56d8f18d8ecc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:01.789466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 456/920] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:01.795984 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5fa6-6fd1-4302-a8ff-56d8f18d8ecc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:01.796539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f14d0-72cb-4c70-a93e-28357a92d9ba None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:01.928907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5fa6-6fd1-4302-a8ff-56d8f18d8ecc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:01.969003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeed568-02ef-483b-a13a-e32d028de585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:01.969655 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeed568-02ef-483b-a13a-e32d028de585 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:01.969935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeed568-02ef-483b-a13a-e32d028de585 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:01.970211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeed568-02ef-483b-a13a-e32d028de585 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:01.970799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeed568-02ef-483b-a13a-e32d028de585 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:01.972809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeed568-02ef-483b-a13a-e32d028de585 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6eeed568-02ef-483b-a13a-e32d028de585 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:01.983331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:01.988981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:01.990430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 457/921] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:59:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:01.999382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeed568-02ef-483b-a13a-e32d028de585 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:02.052484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f14d0-72cb-4c70-a93e-28357a92d9ba None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:02.063391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:02.120739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc4762-20a0-4c5e-98d5-7aa1344424af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:02.122893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc4762-20a0-4c5e-98d5-7aa1344424af None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:02.123649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc4762-20a0-4c5e-98d5-7aa1344424af None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:02.125225 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc4762-20a0-4c5e-98d5-7aa1344424af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:02.134022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeed568-02ef-483b-a13a-e32d028de585 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:02.156804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc4762-20a0-4c5e-98d5-7aa1344424af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:02.165834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc4762-20a0-4c5e-98d5-7aa1344424af None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:02.182997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b1450-2670-466d-bdd1-e5c0d83b46b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:02.184015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1450-2670-466d-bdd1-e5c0d83b46b1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:02.184570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1450-2670-466d-bdd1-e5c0d83b46b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:02.185079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1450-2670-466d-bdd1-e5c0d83b46b1 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:02.185982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b1450-2670-466d-bdd1-e5c0d83b46b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:02.186531 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b1450-2670-466d-bdd1-e5c0d83b46b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:02.188482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b1450-2670-466d-bdd1-e5c0d83b46b1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:02.195718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 458/922] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:59:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c6bc4762-20a0-4c5e-98d5-7aa1344424af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:59:02.218102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:02.219100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:02.220036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:02.220036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:02.220036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:59:02.220036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:59:02.220036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:59:02.220036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:59:02.220036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:59:02.220036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:59:02.220036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:59:02.220036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:02.220616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b1450-2670-466d-bdd1-e5c0d83b46b1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:02.232406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 465/923] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 1 11:59:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:02.234744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc4762-20a0-4c5e-98d5-7aa1344424af None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:02.352170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:02.379481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b1450-2670-466d-bdd1-e5c0d83b46b1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:02.401212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:02.425222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c87f9d-63ca-43ea-96aa-3ec3aaeb3244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:02.426298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c87f9d-63ca-43ea-96aa-3ec3aaeb3244 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:02.426831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c87f9d-63ca-43ea-96aa-3ec3aaeb3244 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:02.427348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c87f9d-63ca-43ea-96aa-3ec3aaeb3244 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:02.428407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c87f9d-63ca-43ea-96aa-3ec3aaeb3244 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:02.429296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c87f9d-63ca-43ea-96aa-3ec3aaeb3244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:02.432087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c87f9d-63ca-43ea-96aa-3ec3aaeb3244 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:02.444494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 459/924] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Sep 1 11:59:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:02.446330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c87f9d-63ca-43ea-96aa-3ec3aaeb3244 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:02.575363 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc4762-20a0-4c5e-98d5-7aa1344424af None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:02.691282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f9438-f54c-4909-8f30-4d1f9d3f9cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:02.694530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f9438-f54c-4909-8f30-4d1f9d3f9cff None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:02.695017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f9438-f54c-4909-8f30-4d1f9d3f9cff None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:02.695506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f9438-f54c-4909-8f30-4d1f9d3f9cff None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:02.704254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f9438-f54c-4909-8f30-4d1f9d3f9cff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:02.704254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f9438-f54c-4909-8f30-4d1f9d3f9cff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:02.704254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f9438-f54c-4909-8f30-4d1f9d3f9cff None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:02.729812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 466/925] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 1 11:59:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:02.739973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f9438-f54c-4909-8f30-4d1f9d3f9cff None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:02.754022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c87f9d-63ca-43ea-96aa-3ec3aaeb3244 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:02.807221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff123f-6509-4fbb-a414-52fec4f74d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:02.809478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff123f-6509-4fbb-a414-52fec4f74d1b None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:02.810056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff123f-6509-4fbb-a414-52fec4f74d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:02.810596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff123f-6509-4fbb-a414-52fec4f74d1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:02.811639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff123f-6509-4fbb-a414-52fec4f74d1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:02.813995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff123f-6509-4fbb-a414-52fec4f74d1b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:02.916062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:02.925101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 460/926] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 11:59:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:59:02.948893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f9438-f54c-4909-8f30-4d1f9d3f9cff None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:03.029221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ffb08-ff4c-4bb4-b15a-f16566c83c15 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:03.030731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ffb08-ff4c-4bb4-b15a-f16566c83c15 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:03.031323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ffb08-ff4c-4bb4-b15a-f16566c83c15 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:03.034792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 461/927] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:03.040933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d9037-1bb6-4570-b4bd-84979d368798 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:03.041125 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d9037-1bb6-4570-b4bd-84979d368798 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:03.041420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d9037-1bb6-4570-b4bd-84979d368798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:03.044609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae8db4-f7d9-415f-822b-60e38a540ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:03.045499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae8db4-f7d9-415f-822b-60e38a540ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:03.046017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae8db4-f7d9-415f-822b-60e38a540ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:03.046415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae8db4-f7d9-415f-822b-60e38a540ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:03.063737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-443d9037-1bb6-4570-b4bd-84979d368798 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:03.065484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-443d9037-1bb6-4570-b4bd-84979d368798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:03.065777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae8db4-f7d9-415f-822b-60e38a540ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:03.067616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae8db4-f7d9-415f-822b-60e38a540ee1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-86ae8db4-f7d9-415f-822b-60e38a540ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:03.100684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:03.101747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:03.102618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:03.102618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:03.102618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:03.104697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 467/928] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:03.113265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:03.116533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae8db4-f7d9-415f-822b-60e38a540ee1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:03.178580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 462/929] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:03.277512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae8db4-f7d9-415f-822b-60e38a540ee1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:03.340464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4bf4-f66c-4124-98b2-66e1b68dd6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:03.341498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4bf4-f66c-4124-98b2-66e1b68dd6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:03.341974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4bf4-f66c-4124-98b2-66e1b68dd6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:03.342545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4bf4-f66c-4124-98b2-66e1b68dd6d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:03.343753 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4bf4-f66c-4124-98b2-66e1b68dd6d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:03.344304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4bf4-f66c-4124-98b2-66e1b68dd6d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:03.346952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4bf4-f66c-4124-98b2-66e1b68dd6d3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:03.352245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:03.371114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 468/930] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:03.376793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d9037-1bb6-4570-b4bd-84979d368798 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:03.485001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4bf4-f66c-4124-98b2-66e1b68dd6d3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:03.499573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d9037-1bb6-4570-b4bd-84979d368798 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:03.554362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afea5ca-8761-479c-88e8-bf38841b0cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:03.554946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea5ca-8761-479c-88e8-bf38841b0cbf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:03.555380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea5ca-8761-479c-88e8-bf38841b0cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:03.555662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afea5ca-8761-479c-88e8-bf38841b0cbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:03.566173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afea5ca-8761-479c-88e8-bf38841b0cbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:03.569028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afea5ca-8761-479c-88e8-bf38841b0cbf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9afea5ca-8761-479c-88e8-bf38841b0cbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:59:03.586390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:03.587344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:03.588710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:59:03.588710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:59:03.588710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:59:03.588710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:59:03.588710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:59:03.588710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:59:03.588710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:03.588710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:03.588710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 463/931] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:59:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:03.593929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afea5ca-8761-479c-88e8-bf38841b0cbf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:03.615790 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4bf4-f66c-4124-98b2-66e1b68dd6d3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:03.628946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:03.664384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37897f-d79f-4b6b-9890-e931700b3914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:03.665437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37897f-d79f-4b6b-9890-e931700b3914 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:03.665930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37897f-d79f-4b6b-9890-e931700b3914 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:03.666457 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37897f-d79f-4b6b-9890-e931700b3914 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:03.667265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37897f-d79f-4b6b-9890-e931700b3914 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:03.669189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37897f-d79f-4b6b-9890-e931700b3914 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-2c37897f-d79f-4b6b-9890-e931700b3914 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:03.679562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:03.680600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 11:59:03.681475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:03.695389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 469/932] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Sep 1 11:59:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:03.697215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37897f-d79f-4b6b-9890-e931700b3914 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:03.718451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afea5ca-8761-479c-88e8-bf38841b0cbf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:03.758468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68147e9-e355-4dbe-a73f-f403b4b10d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:03.759154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68147e9-e355-4dbe-a73f-f403b4b10d86 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:03.759382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68147e9-e355-4dbe-a73f-f403b4b10d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:03.760284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68147e9-e355-4dbe-a73f-f403b4b10d86 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:03.760502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68147e9-e355-4dbe-a73f-f403b4b10d86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:03.760812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68147e9-e355-4dbe-a73f-f403b4b10d86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:03.762285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68147e9-e355-4dbe-a73f-f403b4b10d86 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:03.780955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 464/933] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:59:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:03.783304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2666d-b12f-4965-8379-b6f4b9c8c3eb None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:03.783813 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2666d-b12f-4965-8379-b6f4b9c8c3eb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:03.784333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2666d-b12f-4965-8379-b6f4b9c8c3eb None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:03.788276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 465/934] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:03.792757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2666d-b12f-4965-8379-b6f4b9c8c3eb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:03.805124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:03.851384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37897f-d79f-4b6b-9890-e931700b3914 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:03.898339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeaf98-3c2c-45a5-b484-4a071ee2836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:03.899017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeaf98-3c2c-45a5-b484-4a071ee2836a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:03.899311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeaf98-3c2c-45a5-b484-4a071ee2836a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:03.899575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeaf98-3c2c-45a5-b484-4a071ee2836a None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:03.900243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeaf98-3c2c-45a5-b484-4a071ee2836a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:03.900546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeaf98-3c2c-45a5-b484-4a071ee2836a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:03.901965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeaf98-3c2c-45a5-b484-4a071ee2836a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:03.914967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 470/935] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:59:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:03.914967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ddb89-b793-43c1-97aa-83f2798614ac None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:03.914967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ddb89-b793-43c1-97aa-83f2798614ac None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:03.914967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ddb89-b793-43c1-97aa-83f2798614ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:03.935160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e08ddb89-b793-43c1-97aa-83f2798614ac None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:03.938146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e08ddb89-b793-43c1-97aa-83f2798614ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:03.942556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:03.969031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2666d-b12f-4965-8379-b6f4b9c8c3eb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:04.035505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279983-9ef0-4922-b8f1-cce1459f53b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:04.037166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279983-9ef0-4922-b8f1-cce1459f53b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:04.038056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279983-9ef0-4922-b8f1-cce1459f53b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:04.038056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279983-9ef0-4922-b8f1-cce1459f53b7 None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/9b9457f6eebd49e7858158a1706ec99d/roles/66ad504049f14c468b41216dbc3285a4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:04.041171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c279983-9ef0-4922-b8f1-cce1459f53b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=9b9457f6eebd49e7858158a1706ec99d, role_id=66ad504049f14c468b41216dbc3285a4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:04.044192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c279983-9ef0-4922-b8f1-cce1459f53b7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:04.051093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 471/936] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:04.052570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ddb89-b793-43c1-97aa-83f2798614ac None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:04.161227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:04.168064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 466/937] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:59:03 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/9b9457f6eebd49e7858158a1706ec99d/roles/66ad504049f14c468b41216dbc3285a4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 11:59:04.261975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ddb89-b793-43c1-97aa-83f2798614ac None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:04.330259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ec7c2-c5a4-4977-b593-d46383bab314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:04.331253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec7c2-c5a4-4977-b593-d46383bab314 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:04.331706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec7c2-c5a4-4977-b593-d46383bab314 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:04.332120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec7c2-c5a4-4977-b593-d46383bab314 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:04.333323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ec7c2-c5a4-4977-b593-d46383bab314 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:04.333805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ec7c2-c5a4-4977-b593-d46383bab314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:04.336160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ec7c2-c5a4-4977-b593-d46383bab314 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:04.345685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 472/938] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:59:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:04.355996 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279983-9ef0-4922-b8f1-cce1459f53b7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:04.554364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279983-9ef0-4922-b8f1-cce1459f53b7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:04.571196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ec7c2-c5a4-4977-b593-d46383bab314 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:04.604325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d16689-f8e0-47a9-9ca5-a4b01a7be835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:04.606035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d16689-f8e0-47a9-9ca5-a4b01a7be835 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:04.606794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d16689-f8e0-47a9-9ca5-a4b01a7be835 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:04.607514 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d16689-f8e0-47a9-9ca5-a4b01a7be835 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:04.609055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d16689-f8e0-47a9-9ca5-a4b01a7be835 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:04.612380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d16689-f8e0-47a9-9ca5-a4b01a7be835 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:04.733025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:04.737478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 467/939] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 11:59:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:59:04.790120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ec7c2-c5a4-4977-b593-d46383bab314 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:04.836305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:04.891334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b5dd7-7b5c-4b72-8f27-629bbd6c9e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:04.892906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b5dd7-7b5c-4b72-8f27-629bbd6c9e5f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:04.893567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b5dd7-7b5c-4b72-8f27-629bbd6c9e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:04.894281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b5dd7-7b5c-4b72-8f27-629bbd6c9e5f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:04.896115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b5dd7-7b5c-4b72-8f27-629bbd6c9e5f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:04.899139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b5dd7-7b5c-4b72-8f27-629bbd6c9e5f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-7c0b5dd7-7b5c-4b72-8f27-629bbd6c9e5f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:04.917335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:04.919640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:04.921524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:04.925213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 473/940] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:59:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:04.935293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d16689-f8e0-47a9-9ca5-a4b01a7be835 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:05.130570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d16689-f8e0-47a9-9ca5-a4b01a7be835 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:05.196753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b98db-9f82-4e4a-be10-a2da67c5fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:05.198147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b98db-9f82-4e4a-be10-a2da67c5fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:05.198847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b98db-9f82-4e4a-be10-a2da67c5fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:05.199508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b98db-9f82-4e4a-be10-a2da67c5fdb8 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:05.200935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b98db-9f82-4e4a-be10-a2da67c5fdb8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:05.201630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b98db-9f82-4e4a-be10-a2da67c5fdb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:05.204334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b98db-9f82-4e4a-be10-a2da67c5fdb8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:05.214598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 468/941] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 1 11:59:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:05.223901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b5dd7-7b5c-4b72-8f27-629bbd6c9e5f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:05.343944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b8144-aa3c-4ae6-9353-eb53a103f59a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:05.344445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b8144-aa3c-4ae6-9353-eb53a103f59a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:05.344903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b8144-aa3c-4ae6-9353-eb53a103f59a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:05.347520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 469/942] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:05.358766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0c070-8df3-46e6-96aa-0bed6c4f23a7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:05.359221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0c070-8df3-46e6-96aa-0bed6c4f23a7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:05.359695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0c070-8df3-46e6-96aa-0bed6c4f23a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:05.391180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a8c0c070-8df3-46e6-96aa-0bed6c4f23a7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:05.393318 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8c0c070-8df3-46e6-96aa-0bed6c4f23a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:05.431391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b5dd7-7b5c-4b72-8f27-629bbd6c9e5f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:05.511757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:05.513770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5e621-2077-4407-a499-a94d9f851d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:05.515058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5e621-2077-4407-a499-a94d9f851d70 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:05.516005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5e621-2077-4407-a499-a94d9f851d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:05.518122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5e621-2077-4407-a499-a94d9f851d70 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:05.520475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5e621-2077-4407-a499-a94d9f851d70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:05.521278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5e621-2077-4407-a499-a94d9f851d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:05.524343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5e621-2077-4407-a499-a94d9f851d70 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:05.532558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 470/943] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:05.535145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 474/944] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 1 11:59:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:05.545412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0c070-8df3-46e6-96aa-0bed6c4f23a7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:05.737306 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0c070-8df3-46e6-96aa-0bed6c4f23a7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:05.806528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6afa1-b082-4d37-bfdf-7336a1cc5f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:05.807837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6afa1-b082-4d37-bfdf-7336a1cc5f7a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:05.808485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6afa1-b082-4d37-bfdf-7336a1cc5f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:05.809144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6afa1-b082-4d37-bfdf-7336a1cc5f7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:05.810531 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6afa1-b082-4d37-bfdf-7336a1cc5f7a None admin] RBAC: Adding query filter params (interface=public, service_id=e50f07390d0b4075b27a425d63c271bc, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:05.811239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6afa1-b082-4d37-bfdf-7336a1cc5f7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:05.813864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6afa1-b082-4d37-bfdf-7336a1cc5f7a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:05.825122 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 471/945] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 1 11:59:05 2022] GET /identity/v3/endpoints?service_id=e50f07390d0b4075b27a425d63c271bc&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:05.834327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5e621-2077-4407-a499-a94d9f851d70 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:05.919109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:06.013303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6afa1-b082-4d37-bfdf-7336a1cc5f7a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:06.032086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5e621-2077-4407-a499-a94d9f851d70 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:06.095861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b44aa-d24a-4176-9977-e6963d887eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:06.096897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b44aa-d24a-4176-9977-e6963d887eba None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:06.097387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b44aa-d24a-4176-9977-e6963d887eba None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:06.097861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b44aa-d24a-4176-9977-e6963d887eba None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:06.099021 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b44aa-d24a-4176-9977-e6963d887eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:06.101685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b44aa-d24a-4176-9977-e6963d887eba None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:06.115044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 475/946] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 1 11:59:05 2022] GET /identity/v3/services => generated 1497 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 11:59:06.137387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:06.222585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6afa1-b082-4d37-bfdf-7336a1cc5f7a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:06.292331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:06.293264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:06.293989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:06.294446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:06.295614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:06.298236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:06.302382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: WARNING keystone.server.flask.common [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 11:59:06.325456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98c5c-3a77-4c43-add1-97d35334bd04 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:06.325724 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98c5c-3a77-4c43-add1-97d35334bd04 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:06.326005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98c5c-3a77-4c43-add1-97d35334bd04 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:06.327679 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 476/947] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:06.334871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e116b-cc05-46b1-a2aa-0b1c53a4df02 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:06.335243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e116b-cc05-46b1-a2aa-0b1c53a4df02 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:06.335682 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e116b-cc05-46b1-a2aa-0b1c53a4df02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:06.365912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-410e116b-cc05-46b1-a2aa-0b1c53a4df02 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:06.368287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-410e116b-cc05-46b1-a2aa-0b1c53a4df02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:06.369731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.sql.core [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 11:59:06.369731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 11:59:06.369731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [parameters: {'id': 'c8e7423af618477dbce4fc8b5e965748', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 11:59:06.369731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81863) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8e7423af618477dbce4fc8b5e965748.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8e7423af618477dbce4fc8b5e965748. Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application conn.query(q) Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 11:59:06.386935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result.read() Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 11:59:06.388433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application next(self.gen) Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application yield resource Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application next(self.gen) Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise self.value Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application session.commit() Sep 01 11:59:06.389571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.session.flush() Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application compat.raise_( Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 11:59:06.391413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 11:59:06.393930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application conn.query(q) Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result.read() Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 11:59:06.396441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [parameters: {'id': 'c8e7423af618477dbce4fc8b5e965748', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:06.398467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:06.404363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c8e7423af618477dbce4fc8b5e965748. Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 472/948] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Sep 1 11:59:06 2022] POST /identity/v3/projects => generated 262 bytes in 377 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:06.408559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:06.512278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 477/949] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:06.619164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ab226-bef3-41cf-a0a4-b4a58768852a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:06.644813 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:06.691126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c8e38-613f-4f25-a59a-bcf0702017c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:06.692155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8e38-613f-4f25-a59a-bcf0702017c0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:06.692675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8e38-613f-4f25-a59a-bcf0702017c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:06.696537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8e38-613f-4f25-a59a-bcf0702017c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:06.701872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c8e38-613f-4f25-a59a-bcf0702017c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:06.704043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c8e38-613f-4f25-a59a-bcf0702017c0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7f1c8e38-613f-4f25-a59a-bcf0702017c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:59:06.718837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:06.719974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:06.720929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:59:06.720929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:59:06.720929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:59:06.720929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:59:06.720929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:59:06.720929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:59:06.720929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:06.720929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:06.724044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 473/950] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:06.733802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e116b-cc05-46b1-a2aa-0b1c53a4df02 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:06.785401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:06.895472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c8e38-613f-4f25-a59a-bcf0702017c0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:06.913076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e116b-cc05-46b1-a2aa-0b1c53a4df02 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:06.979970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f06b8-2239-47d9-a7f3-6feccb10c43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:06.981053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f06b8-2239-47d9-a7f3-6feccb10c43d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:06.981541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f06b8-2239-47d9-a7f3-6feccb10c43d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:06.982024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f06b8-2239-47d9-a7f3-6feccb10c43d None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:06.983267 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f06b8-2239-47d9-a7f3-6feccb10c43d None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:06.983786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f06b8-2239-47d9-a7f3-6feccb10c43d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:06.986540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f06b8-2239-47d9-a7f3-6feccb10c43d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:07.023796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 478/951] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:59:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:07.035719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c8e38-613f-4f25-a59a-bcf0702017c0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:07.109302 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84982d-dd53-45ec-8590-a920398c7f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:07.110460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84982d-dd53-45ec-8590-a920398c7f3e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:07.110999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84982d-dd53-45ec-8590-a920398c7f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:07.111478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84982d-dd53-45ec-8590-a920398c7f3e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:07.133763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84982d-dd53-45ec-8590-a920398c7f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-af84982d-dd53-45ec-8590-a920398c7f3e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:59:07.144442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:07.145647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:59:07.146492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:07.147139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 474/952] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 1 11:59:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:07.154094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f06b8-2239-47d9-a7f3-6feccb10c43d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:07.293852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:07.301914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f06b8-2239-47d9-a7f3-6feccb10c43d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:07.344805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd2856-9b21-49c4-a112-9f358605487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:07.345503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2856-9b21-49c4-a112-9f358605487d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:07.345778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2856-9b21-49c4-a112-9f358605487d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:07.346053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2856-9b21-49c4-a112-9f358605487d None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:07.346744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd2856-9b21-49c4-a112-9f358605487d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:07.347046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd2856-9b21-49c4-a112-9f358605487d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:07.348533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd2856-9b21-49c4-a112-9f358605487d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:07.358412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 479/953] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 1 11:59:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:07.364027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84982d-dd53-45ec-8590-a920398c7f3e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:07.424826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:07.556136 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84982d-dd53-45ec-8590-a920398c7f3e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:07.620367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563f78b-85b3-4d98-8f09-b5eca37f4d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:07.621442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563f78b-85b3-4d98-8f09-b5eca37f4d04 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:07.621931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563f78b-85b3-4d98-8f09-b5eca37f4d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:07.622418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563f78b-85b3-4d98-8f09-b5eca37f4d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:07.645741 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563f78b-85b3-4d98-8f09-b5eca37f4d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:07.646107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563f78b-85b3-4d98-8f09-b5eca37f4d04 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e563f78b-85b3-4d98-8f09-b5eca37f4d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:07.675718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:07.676870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:07.677771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:07.677771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:07.677771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:07.678444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 475/954] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:07.688452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd2856-9b21-49c4-a112-9f358605487d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:07.877879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd2856-9b21-49c4-a112-9f358605487d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:07.923431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988dacb-fee3-437d-8417-4a652d4d3f82 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:07.923943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988dacb-fee3-437d-8417-4a652d4d3f82 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:07.924518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988dacb-fee3-437d-8417-4a652d4d3f82 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:07.940309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 476/955] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:07 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:07.942639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa63fa-1540-4f04-a130-5a9dca31b792 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:07.943144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa63fa-1540-4f04-a130-5a9dca31b792 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:07.943639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa63fa-1540-4f04-a130-5a9dca31b792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:07.945931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e862b90-2d00-4b2e-a9f9-6b8183f6ad30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:07.947930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862b90-2d00-4b2e-a9f9-6b8183f6ad30 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:07.948853 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862b90-2d00-4b2e-a9f9-6b8183f6ad30 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:07.949574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e862b90-2d00-4b2e-a9f9-6b8183f6ad30 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:07.950974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e862b90-2d00-4b2e-a9f9-6b8183f6ad30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:07.951731 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e862b90-2d00-4b2e-a9f9-6b8183f6ad30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:07.955006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e862b90-2d00-4b2e-a9f9-6b8183f6ad30 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:07.980534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 480/956] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:07.981808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c3aa63fa-1540-4f04-a130-5a9dca31b792 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:07.984958 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c3aa63fa-1540-4f04-a130-5a9dca31b792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:07.986228 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e862b90-2d00-4b2e-a9f9-6b8183f6ad30 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:08.031929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:08.077680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 477/957] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:08.197897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e862b90-2d00-4b2e-a9f9-6b8183f6ad30 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:08.265560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4a40e-a169-4f41-ba40-91b4c6d33da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:08.266655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a40e-a169-4f41-ba40-91b4c6d33da2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:08.267142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a40e-a169-4f41-ba40-91b4c6d33da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:08.267620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a40e-a169-4f41-ba40-91b4c6d33da2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:08.283170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4a40e-a169-4f41-ba40-91b4c6d33da2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:08.286527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4a40e-a169-4f41-ba40-91b4c6d33da2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f6c4a40e-a169-4f41-ba40-91b4c6d33da2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:59:08.311472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:08.312515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:08.313460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:08.313460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:08.313460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:59:08.313460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:59:08.313460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:59:08.313460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:59:08.313460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:59:08.313460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:59:08.313460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 11:59:08.313460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:08.314499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 481/958] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 1 11:59:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:08.320897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa63fa-1540-4f04-a130-5a9dca31b792 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:08.344634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:08.398985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4a40e-a169-4f41-ba40-91b4c6d33da2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:08.492454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:08.516100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4a40e-a169-4f41-ba40-91b4c6d33da2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:08.528239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa63fa-1540-4f04-a130-5a9dca31b792 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:08.573998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892d16-c861-4273-b262-c89bcdba293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:08.574633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892d16-c861-4273-b262-c89bcdba293c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:08.574913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892d16-c861-4273-b262-c89bcdba293c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:08.575191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892d16-c861-4273-b262-c89bcdba293c None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:08.576022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d892d16-c861-4273-b262-c89bcdba293c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:08.576369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d892d16-c861-4273-b262-c89bcdba293c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:08.577943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d892d16-c861-4273-b262-c89bcdba293c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:08.579863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f354f-8c10-4a7d-b47d-c5d8e61db524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:08.581204 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f354f-8c10-4a7d-b47d-c5d8e61db524 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:08.581780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f354f-8c10-4a7d-b47d-c5d8e61db524 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:08.582863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f354f-8c10-4a7d-b47d-c5d8e61db524 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:08.584005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f354f-8c10-4a7d-b47d-c5d8e61db524 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:08.586695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f354f-8c10-4a7d-b47d-c5d8e61db524 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:08.599991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 478/959] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Sep 1 11:59:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-154f354f-8c10-4a7d-b47d-c5d8e61db524 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:08.604948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:08.606061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 11:59:08.606912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:08.607816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 482/960] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:59:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:08.609328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892d16-c861-4273-b262-c89bcdba293c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:08.613123 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f354f-8c10-4a7d-b47d-c5d8e61db524 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:08.703680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:08.769427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f354f-8c10-4a7d-b47d-c5d8e61db524 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:08.769747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892d16-c861-4273-b262-c89bcdba293c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:08.787846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6093af3-0050-4d86-b216-82974333fde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:08.788530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6093af3-0050-4d86-b216-82974333fde4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:08.788813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6093af3-0050-4d86-b216-82974333fde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:08.789082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6093af3-0050-4d86-b216-82974333fde4 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:08.789746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6093af3-0050-4d86-b216-82974333fde4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:08.790045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6093af3-0050-4d86-b216-82974333fde4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:08.791737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6093af3-0050-4d86-b216-82974333fde4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:08.800429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 483/961] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:59:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:08.804364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6093af3-0050-4d86-b216-82974333fde4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:08.821420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff52b26-5c75-4b46-9956-0b446a3ac303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:08.822850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff52b26-5c75-4b46-9956-0b446a3ac303 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:08.822850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff52b26-5c75-4b46-9956-0b446a3ac303 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:08.822850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff52b26-5c75-4b46-9956-0b446a3ac303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:08.833949 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:08.917236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff52b26-5c75-4b46-9956-0b446a3ac303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:08.919614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff52b26-5c75-4b46-9956-0b446a3ac303 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:09.015446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6093af3-0050-4d86-b216-82974333fde4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:09.022799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:09.067887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 479/962] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:59:08 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 11:59:09.068257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7f82e-d8ae-4e41-90aa-d39f2c4bcd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:09.068931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7f82e-d8ae-4e41-90aa-d39f2c4bcd61 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:09.069213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7f82e-d8ae-4e41-90aa-d39f2c4bcd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:09.069490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7f82e-d8ae-4e41-90aa-d39f2c4bcd61 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:09.070133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff52b26-5c75-4b46-9956-0b446a3ac303 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:09.070245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7f82e-d8ae-4e41-90aa-d39f2c4bcd61 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:09.070442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7f82e-d8ae-4e41-90aa-d39f2c4bcd61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:09.071873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7f82e-d8ae-4e41-90aa-d39f2c4bcd61 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:09.080353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 484/963] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:59:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:09.197491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff52b26-5c75-4b46-9956-0b446a3ac303 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:09.238003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeac7d4-4999-4dd6-b6b3-5579ff2a3493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:09.239582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac7d4-4999-4dd6-b6b3-5579ff2a3493 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:09.240116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac7d4-4999-4dd6-b6b3-5579ff2a3493 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:09.240662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac7d4-4999-4dd6-b6b3-5579ff2a3493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:09.256377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeac7d4-4999-4dd6-b6b3-5579ff2a3493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:09.258524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeac7d4-4999-4dd6-b6b3-5579ff2a3493 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0aeac7d4-4999-4dd6-b6b3-5579ff2a3493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:09.279446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:09.280844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:09.281740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:09.281740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:09.281740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:09.284504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 480/964] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:09.292607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7f82e-d8ae-4e41-90aa-d39f2c4bcd61 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:09.353376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50894ed-5f57-438f-bb4c-63817b4618ee None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:09.354216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50894ed-5f57-438f-bb4c-63817b4618ee None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:09.354562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50894ed-5f57-438f-bb4c-63817b4618ee None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:09.356394 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 481/965] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:09.366873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fab2c7-2a89-431d-b129-09cb33276a67 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:09.367340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fab2c7-2a89-431d-b129-09cb33276a67 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:09.367812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fab2c7-2a89-431d-b129-09cb33276a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:09.402184 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-16fab2c7-2a89-431d-b129-09cb33276a67 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:09.403876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16fab2c7-2a89-431d-b129-09cb33276a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:09.409405 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:09.440103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:09.453200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7f82e-d8ae-4e41-90aa-d39f2c4bcd61 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:09.521731 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f1152-3595-46a6-80a6-269818650b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:09.523274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f1152-3595-46a6-80a6-269818650b38 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:09.523979 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f1152-3595-46a6-80a6-269818650b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:09.524813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f1152-3595-46a6-80a6-269818650b38 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:09.526423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f1152-3595-46a6-80a6-269818650b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:09.527232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f1152-3595-46a6-80a6-269818650b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:09.530278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f1152-3595-46a6-80a6-269818650b38 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:09.544709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 482/966] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:09.556284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 485/967] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:09.562158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fab2c7-2a89-431d-b129-09cb33276a67 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:09.763077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fab2c7-2a89-431d-b129-09cb33276a67 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:09.813982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edca46-1aba-4e3d-8b9e-997d18b1b653 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:09.814248 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edca46-1aba-4e3d-8b9e-997d18b1b653 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:09.814577 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edca46-1aba-4e3d-8b9e-997d18b1b653 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:09.816057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 486/968] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:09.826797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f638096-7f68-405b-8e3a-7359617275ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:09.827361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1948f-1381-4ce1-bd54-2a8be2a215ab None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:09.827873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638096-7f68-405b-8e3a-7359617275ac None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:09.828370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638096-7f68-405b-8e3a-7359617275ac None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:09.828679 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1948f-1381-4ce1-bd54-2a8be2a215ab None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:09.828863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638096-7f68-405b-8e3a-7359617275ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:09.829563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1948f-1381-4ce1-bd54-2a8be2a215ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:09.838950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f638096-7f68-405b-8e3a-7359617275ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:09.840428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f638096-7f68-405b-8e3a-7359617275ac None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8f638096-7f68-405b-8e3a-7359617275ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:59:09.862877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:09.865104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:09.867160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:59:09.867160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:59:09.867160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:59:09.867160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:59:09.867160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:59:09.867160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:59:09.867160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:09.867160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:09.868489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-32a1948f-1381-4ce1-bd54-2a8be2a215ab None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:09.868489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-32a1948f-1381-4ce1-bd54-2a8be2a215ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:09.869078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 483/969] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:09.870734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f638096-7f68-405b-8e3a-7359617275ac None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:09.893153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:09.963175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 487/970] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:09.964054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1948f-1381-4ce1-bd54-2a8be2a215ab None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:10.020926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f638096-7f68-405b-8e3a-7359617275ac None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:10.049732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:10.062042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20d175-43e0-4723-a0c9-3bd074ef5ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:10.062812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20d175-43e0-4723-a0c9-3bd074ef5ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:10.063093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20d175-43e0-4723-a0c9-3bd074ef5ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:10.063526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20d175-43e0-4723-a0c9-3bd074ef5ed3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:10.064481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20d175-43e0-4723-a0c9-3bd074ef5ed3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:10.066163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20d175-43e0-4723-a0c9-3bd074ef5ed3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ff20d175-43e0-4723-a0c9-3bd074ef5ed3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:10.077477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:10.078530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:10.079347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:10.084457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 484/971] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:59:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:10.085574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20d175-43e0-4723-a0c9-3bd074ef5ed3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:10.105947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1948f-1381-4ce1-bd54-2a8be2a215ab None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:10.149417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835d64-3a1c-45e3-a839-4f97a499fcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:10.150455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835d64-3a1c-45e3-a839-4f97a499fcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:10.150905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835d64-3a1c-45e3-a839-4f97a499fcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:10.151400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835d64-3a1c-45e3-a839-4f97a499fcc3 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:10.152459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f835d64-3a1c-45e3-a839-4f97a499fcc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:10.152997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f835d64-3a1c-45e3-a839-4f97a499fcc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:10.154678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f835d64-3a1c-45e3-a839-4f97a499fcc3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:10.168931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 488/972] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:10.175704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835d64-3a1c-45e3-a839-4f97a499fcc3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:10.182198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:10.214160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20d175-43e0-4723-a0c9-3bd074ef5ed3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:10.255081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d444f-832c-41c7-98d7-65a6aa364ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:10.255858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d444f-832c-41c7-98d7-65a6aa364ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:10.256224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d444f-832c-41c7-98d7-65a6aa364ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:10.256632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d444f-832c-41c7-98d7-65a6aa364ab6 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:10.257425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d444f-832c-41c7-98d7-65a6aa364ab6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:10.257806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d444f-832c-41c7-98d7-65a6aa364ab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:10.259257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d444f-832c-41c7-98d7-65a6aa364ab6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:10.269614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 485/973] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 1 11:59:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:10.270672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d444f-832c-41c7-98d7-65a6aa364ab6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:10.324450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835d64-3a1c-45e3-a839-4f97a499fcc3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:10.351922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:10.370327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582c703-a038-4dd3-a354-71494910667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:10.371302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582c703-a038-4dd3-a354-71494910667b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:10.371766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582c703-a038-4dd3-a354-71494910667b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:10.372283 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582c703-a038-4dd3-a354-71494910667b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:10.373463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582c703-a038-4dd3-a354-71494910667b None admin] RBAC: Adding query filter params (role.id=66ad504049f14c468b41216dbc3285a4, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=9b9457f6eebd49e7858158a1706ec99d) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:10.374156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582c703-a038-4dd3-a354-71494910667b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:10.375630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582c703-a038-4dd3-a354-71494910667b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:10.384127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 489/974] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:59:10 2022] GET /identity/v3/role_assignments?user.id=9b9457f6eebd49e7858158a1706ec99d&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=66ad504049f14c468b41216dbc3285a4 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:10.384127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582c703-a038-4dd3-a354-71494910667b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:10.403002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d444f-832c-41c7-98d7-65a6aa364ab6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:10.461106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e9c18-72fd-4cdd-9ff2-933f5b999b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:10.462161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9c18-72fd-4cdd-9ff2-933f5b999b64 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:10.462643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9c18-72fd-4cdd-9ff2-933f5b999b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:10.463175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9c18-72fd-4cdd-9ff2-933f5b999b64 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:10.464249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e9c18-72fd-4cdd-9ff2-933f5b999b64 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:10.464851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e9c18-72fd-4cdd-9ff2-933f5b999b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:10.466506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e9c18-72fd-4cdd-9ff2-933f5b999b64 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:10.473526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 486/975] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 1 11:59:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:10.481447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e9c18-72fd-4cdd-9ff2-933f5b999b64 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:10.496842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:10.531310 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582c703-a038-4dd3-a354-71494910667b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:10.610242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:10.611180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:10.611682 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:10.612137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:10.613970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:10.617217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:10.623058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WARNING keystone.server.flask.common [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 11:59:10.649813 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e9c18-72fd-4cdd-9ff2-933f5b999b64 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:10.690506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.sql.core [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 11:59:10.690506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 11:59:10.690506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [parameters: {'user_id': '1d6cca23936b44099d14d5d43c970002', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 11:59:10.690506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81864) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 11:59:10.708012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096858c-a18f-49f3-be75-eced29ecd45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:10.708730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096858c-a18f-49f3-be75-eced29ecd45c None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:10.709047 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096858c-a18f-49f3-be75-eced29ecd45c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:10.709362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096858c-a18f-49f3-be75-eced29ecd45c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:10.710042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096858c-a18f-49f3-be75-eced29ecd45c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:10.711457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096858c-a18f-49f3-be75-eced29ecd45c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application conn.query(q) Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application result.read() Sep 01 11:59:10.727802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 11:59:10.730066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application next(self.gen) Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application yield resource Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application next(self.gen) Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise self.value Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application session.commit() Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 11:59:10.732370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self.session.flush() Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application compat.raise_( Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 11:59:10.741694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 11:59:10.743395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application conn.query(q) Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application result.read() Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 11:59:10.747139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [parameters: {'user_id': '1d6cca23936b44099d14d5d43c970002', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:10.750635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 11:59:10.754097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 11:59:10.758757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 11:59:10.758757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 11:59:10.758757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 11:59:10.758757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 11:59:10.758757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 11:59:10.758757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:10.758757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 490/976] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Sep 1 11:59:10 2022] POST /identity/v3/users => generated 160 bytes in 352 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:10.758757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:10.799798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:10.824253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 487/977] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 11:59:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 11:59:10.925660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c9f76-3255-43dd-b209-3420c573c158 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:10.976993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121e2af-fecb-4b04-acea-09615be1eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:10.977643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121e2af-fecb-4b04-acea-09615be1eaec None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:10.977923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121e2af-fecb-4b04-acea-09615be1eaec None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:10.978197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121e2af-fecb-4b04-acea-09615be1eaec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:10.987030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121e2af-fecb-4b04-acea-09615be1eaec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:10.989351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121e2af-fecb-4b04-acea-09615be1eaec None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-0121e2af-fecb-4b04-acea-09615be1eaec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:59:11.002269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:11.003271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:11.005360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 491/978] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:59:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:11.012927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096858c-a18f-49f3-be75-eced29ecd45c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:11.095799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:11.145982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096858c-a18f-49f3-be75-eced29ecd45c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:11.183511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e26f3-7208-4c8b-aae7-231e08882897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:11.184399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e26f3-7208-4c8b-aae7-231e08882897 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:11.184820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e26f3-7208-4c8b-aae7-231e08882897 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:11.185263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e26f3-7208-4c8b-aae7-231e08882897 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:11.186128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e26f3-7208-4c8b-aae7-231e08882897 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:11.186590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e26f3-7208-4c8b-aae7-231e08882897 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:11.188519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e26f3-7208-4c8b-aae7-231e08882897 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:11.229298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 488/979] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Sep 1 11:59:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:11.277610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895672f8-e989-4f75-b925-f1b36c8ac40c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:11.278132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895672f8-e989-4f75-b925-f1b36c8ac40c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:11.278239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895672f8-e989-4f75-b925-f1b36c8ac40c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:11.279901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 492/980] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:11.285933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2144f1f-a028-4198-b6be-1cdfe99e691a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:11.286245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2144f1f-a028-4198-b6be-1cdfe99e691a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:11.286499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2144f1f-a028-4198-b6be-1cdfe99e691a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:11.307351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b2144f1f-a028-4198-b6be-1cdfe99e691a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:11.308652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b2144f1f-a028-4198-b6be-1cdfe99e691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:11.395524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 489/981] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:11.669524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895672f8-e989-4f75-b925-f1b36c8ac40c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:11.837004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895672f8-e989-4f75-b925-f1b36c8ac40c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:11.839169 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:11.894095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b6f8-09cd-4ac4-857d-11e6130b612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:11.895296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b6f8-09cd-4ac4-857d-11e6130b612e None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:11.895556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b6f8-09cd-4ac4-857d-11e6130b612e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:11.895833 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b6f8-09cd-4ac4-857d-11e6130b612e None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:11.896821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1b6f8-09cd-4ac4-857d-11e6130b612e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:11.898692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1b6f8-09cd-4ac4-857d-11e6130b612e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:11.990137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 493/982] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:59:11 2022] POST /identity/v3/services => generated 242 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:59:12.758606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516afaa-5632-41f5-97aa-0362823d0cfe None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:12.759185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516afaa-5632-41f5-97aa-0362823d0cfe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:12.759519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516afaa-5632-41f5-97aa-0362823d0cfe None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:12.762071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 490/983] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:12.768568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c6dab-2c67-48d5-9d70-fa90bac09d14 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:12.769327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c6dab-2c67-48d5-9d70-fa90bac09d14 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:12.769327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c6dab-2c67-48d5-9d70-fa90bac09d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:12.794340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b30c6dab-2c67-48d5-9d70-fa90bac09d14 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:12.796584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b30c6dab-2c67-48d5-9d70-fa90bac09d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:12.901008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f42d06-34f7-49af-915c-704c1227a5c3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:12.901549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f42d06-34f7-49af-915c-704c1227a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:12.902022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f42d06-34f7-49af-915c-704c1227a5c3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:12.904130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 491/984] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:12.908255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 494/985] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:12.909855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd80d3d-a577-4577-8deb-e07b20e16d0c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:12.910171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd80d3d-a577-4577-8deb-e07b20e16d0c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:12.910447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd80d3d-a577-4577-8deb-e07b20e16d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:12.930727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7bd80d3d-a577-4577-8deb-e07b20e16d0c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:12.932035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7bd80d3d-a577-4577-8deb-e07b20e16d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:12.989048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:13.018393 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 492/986] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:13.190278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c6dab-2c67-48d5-9d70-fa90bac09d14 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:13.287682 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:13.293176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd80d3d-a577-4577-8deb-e07b20e16d0c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:13.302227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c6dab-2c67-48d5-9d70-fa90bac09d14 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:13.357172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ad952-ae48-42d2-9ef4-4b5ba241b451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:13.358248 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad952-ae48-42d2-9ef4-4b5ba241b451 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:13.359024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad952-ae48-42d2-9ef4-4b5ba241b451 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:13.359721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad952-ae48-42d2-9ef4-4b5ba241b451 None admin] PATH_INFO: `/v3/services/image` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:13.360996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ad952-ae48-42d2-9ef4-4b5ba241b451 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:13.363594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ad952-ae48-42d2-9ef4-4b5ba241b451 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6f0ad952-ae48-42d2-9ef4-4b5ba241b451 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:13.373854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:13.376010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 11:59:13.377803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:13.380789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 495/987] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Sep 1 11:59:13 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:13.383722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ad952-ae48-42d2-9ef4-4b5ba241b451 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:13.414371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd80d3d-a577-4577-8deb-e07b20e16d0c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:13.458163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea6b51-5db5-4610-b4d2-5c3ca03315bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:13.458907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea6b51-5db5-4610-b4d2-5c3ca03315bc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:13.459250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea6b51-5db5-4610-b4d2-5c3ca03315bc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:13.459605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea6b51-5db5-4610-b4d2-5c3ca03315bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:13.460350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea6b51-5db5-4610-b4d2-5c3ca03315bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:13.461824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea6b51-5db5-4610-b4d2-5c3ca03315bc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-edea6b51-5db5-4610-b4d2-5c3ca03315bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:13.471537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:13.473592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:13.476575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 493/988] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:59:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:13.481859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea6b51-5db5-4610-b4d2-5c3ca03315bc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:13.538009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:13.574843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ad952-ae48-42d2-9ef4-4b5ba241b451 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:13.608543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea6b51-5db5-4610-b4d2-5c3ca03315bc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:13.634083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2911d65-8739-41c3-8316-a021acdacec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:13.635113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911d65-8739-41c3-8316-a021acdacec5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:13.635543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911d65-8739-41c3-8316-a021acdacec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:13.636011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911d65-8739-41c3-8316-a021acdacec5 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:13.637247 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2911d65-8739-41c3-8316-a021acdacec5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:13.637782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2911d65-8739-41c3-8316-a021acdacec5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:13.640567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2911d65-8739-41c3-8316-a021acdacec5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:13.650870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 496/989] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:13.656596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2911d65-8739-41c3-8316-a021acdacec5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:13.661162 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a84bb4-d863-4da9-aae4-0e1eb0d2bf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:13.661797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84bb4-d863-4da9-aae4-0e1eb0d2bf3b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:13.662083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84bb4-d863-4da9-aae4-0e1eb0d2bf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:13.662362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84bb4-d863-4da9-aae4-0e1eb0d2bf3b None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:13.663933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a84bb4-d863-4da9-aae4-0e1eb0d2bf3b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:13.664409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a84bb4-d863-4da9-aae4-0e1eb0d2bf3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:13.665812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a84bb4-d863-4da9-aae4-0e1eb0d2bf3b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:13.672252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 494/990] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 1 11:59:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:13.678671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a84bb4-d863-4da9-aae4-0e1eb0d2bf3b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:13.687620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:13.790910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a84bb4-d863-4da9-aae4-0e1eb0d2bf3b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:13.803478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:13.805000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2911d65-8739-41c3-8316-a021acdacec5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:13.852342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b65e-2077-412c-a431-eeae88f8a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:13.853563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b65e-2077-412c-a431-eeae88f8a150 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:13.854073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b65e-2077-412c-a431-eeae88f8a150 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:13.854577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b65e-2077-412c-a431-eeae88f8a150 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:13.855793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b65e-2077-412c-a431-eeae88f8a150 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:13.856392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b65e-2077-412c-a431-eeae88f8a150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:13.859116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b65e-2077-412c-a431-eeae88f8a150 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:13.865039 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cf2a6-05ee-4b7e-8cf5-8e86ccf7a837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:13.865949 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf2a6-05ee-4b7e-8cf5-8e86ccf7a837 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:13.866368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf2a6-05ee-4b7e-8cf5-8e86ccf7a837 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:13.866785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf2a6-05ee-4b7e-8cf5-8e86ccf7a837 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:13.867771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cf2a6-05ee-4b7e-8cf5-8e86ccf7a837 None admin] RBAC: Adding query filter params (type=image) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:13.868269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cf2a6-05ee-4b7e-8cf5-8e86ccf7a837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:13.874563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 495/991] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 1 11:59:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:13.874791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cf2a6-05ee-4b7e-8cf5-8e86ccf7a837 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:13.875643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b65e-2077-412c-a431-eeae88f8a150 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:13.882026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 497/992] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:14.016246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b65e-2077-412c-a431-eeae88f8a150 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:14.071067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89bca-16bf-4df6-983c-39ce27fdcaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:14.071689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89bca-16bf-4df6-983c-39ce27fdcaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:14.072021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89bca-16bf-4df6-983c-39ce27fdcaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:14.072396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89bca-16bf-4df6-983c-39ce27fdcaa1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:14.073477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec89bca-16bf-4df6-983c-39ce27fdcaa1 None admin] RBAC: Adding query filter params (interface=admin, service_id=e50f07390d0b4075b27a425d63c271bc, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:14.074030 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec89bca-16bf-4df6-983c-39ce27fdcaa1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:14.076055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec89bca-16bf-4df6-983c-39ce27fdcaa1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:14.080082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aeab5-50a4-40cb-856e-ed750c3de699 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:14.080405 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aeab5-50a4-40cb-856e-ed750c3de699 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:14.080685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aeab5-50a4-40cb-856e-ed750c3de699 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:14.082236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 498/993] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:14.083473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 496/994] 10.222.0.18 () {56 vars in 1249 bytes} [Thu Sep 1 11:59:13 2022] GET /identity/v3/endpoints?service_id=e50f07390d0b4075b27a425d63c271bc&interface=admin®ion_id=RegionOne => generated 193 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:14.089089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89bca-16bf-4df6-983c-39ce27fdcaa1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:14.089248 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80561c-ed96-40c5-bf8f-c15923741264 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:14.089522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80561c-ed96-40c5-bf8f-c15923741264 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:14.089955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80561c-ed96-40c5-bf8f-c15923741264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:14.117521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bf80561c-ed96-40c5-bf8f-c15923741264 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:14.119342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bf80561c-ed96-40c5-bf8f-c15923741264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:14.146098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:14.226708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 499/995] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:14.256154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89bca-16bf-4df6-983c-39ce27fdcaa1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:14.316523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946d2d-6162-4dcd-91ae-20e154267393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:14.317528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946d2d-6162-4dcd-91ae-20e154267393 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:14.317999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946d2d-6162-4dcd-91ae-20e154267393 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:14.318476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946d2d-6162-4dcd-91ae-20e154267393 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:14.319559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c946d2d-6162-4dcd-91ae-20e154267393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:14.322100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c946d2d-6162-4dcd-91ae-20e154267393 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:14.341110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 497/996] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 1 11:59:14 2022] GET /identity/v3/services => generated 1727 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 11:59:14.547306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80561c-ed96-40c5-bf8f-c15923741264 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:14.559698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:14.660247 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80561c-ed96-40c5-bf8f-c15923741264 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:14.701254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec741e9b-d476-4a45-88fa-bc69686fc158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:14.701901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741e9b-d476-4a45-88fa-bc69686fc158 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:14.702172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741e9b-d476-4a45-88fa-bc69686fc158 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:14.702439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741e9b-d476-4a45-88fa-bc69686fc158 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:14.703025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec741e9b-d476-4a45-88fa-bc69686fc158 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:14.704412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec741e9b-d476-4a45-88fa-bc69686fc158 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-ec741e9b-d476-4a45-88fa-bc69686fc158 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:14.714386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:14.715470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 11:59:14.716758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:14.717852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 500/997] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:59:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:14.721843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946d2d-6162-4dcd-91ae-20e154267393 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:14.829320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:14.833623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946d2d-6162-4dcd-91ae-20e154267393 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:14.872285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf40b5-6c74-4292-a139-b8d5a793dbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:14.872903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf40b5-6c74-4292-a139-b8d5a793dbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:14.873182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf40b5-6c74-4292-a139-b8d5a793dbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:14.873453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf40b5-6c74-4292-a139-b8d5a793dbc0 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:14.874110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf40b5-6c74-4292-a139-b8d5a793dbc0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:14.874419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf40b5-6c74-4292-a139-b8d5a793dbc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:14.875803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf40b5-6c74-4292-a139-b8d5a793dbc0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:14.886427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 498/998] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:59:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:14.888262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec741e9b-d476-4a45-88fa-bc69686fc158 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:14.976649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:15.002140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec741e9b-d476-4a45-88fa-bc69686fc158 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:15.039551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18aa4a-54fc-4b9c-b0f6-db5e049083dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:15.040158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18aa4a-54fc-4b9c-b0f6-db5e049083dc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:15.040470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18aa4a-54fc-4b9c-b0f6-db5e049083dc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:15.040742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18aa4a-54fc-4b9c-b0f6-db5e049083dc None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:15.041373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18aa4a-54fc-4b9c-b0f6-db5e049083dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:15.041673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18aa4a-54fc-4b9c-b0f6-db5e049083dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:15.043028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18aa4a-54fc-4b9c-b0f6-db5e049083dc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:15.053797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 501/999] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:59:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:15.054879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf40b5-6c74-4292-a139-b8d5a793dbc0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:15.155132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf40b5-6c74-4292-a139-b8d5a793dbc0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:15.190772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ab126-4740-4541-bdb4-a909ecb5d383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:15.191419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ab126-4740-4541-bdb4-a909ecb5d383 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:15.191695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ab126-4740-4541-bdb4-a909ecb5d383 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:15.191965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ab126-4740-4541-bdb4-a909ecb5d383 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:15.192700 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ab126-4740-4541-bdb4-a909ecb5d383 None admin] RBAC: Adding query filter params (interface=public, service_id=d8871288fa514e119e005ae915d71441, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:15.193004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ab126-4740-4541-bdb4-a909ecb5d383 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:15.194374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ab126-4740-4541-bdb4-a909ecb5d383 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:15.200201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 499/1000] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 1 11:59:15 2022] GET /identity/v3/endpoints?service_id=d8871288fa514e119e005ae915d71441&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:15.205884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18aa4a-54fc-4b9c-b0f6-db5e049083dc None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:15.320064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18aa4a-54fc-4b9c-b0f6-db5e049083dc None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:15.357806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb944ff2-b4a1-42e7-932e-9d5d74ecd2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:15.358418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb944ff2-b4a1-42e7-932e-9d5d74ecd2fb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:15.358684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb944ff2-b4a1-42e7-932e-9d5d74ecd2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:15.358959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb944ff2-b4a1-42e7-932e-9d5d74ecd2fb None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:15.359563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb944ff2-b4a1-42e7-932e-9d5d74ecd2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:15.360958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb944ff2-b4a1-42e7-932e-9d5d74ecd2fb None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:15.376262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 502/1001] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 1 11:59:15 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 11:59:15.890495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad9ccd-78c5-4e50-8762-5dffa17cb61a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:15.891049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad9ccd-78c5-4e50-8762-5dffa17cb61a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:15.891049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad9ccd-78c5-4e50-8762-5dffa17cb61a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:15.892468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 500/1002] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:15.898421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cf738-d637-47b1-bd0f-55c7cf69daf9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:15.899155 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cf738-d637-47b1-bd0f-55c7cf69daf9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:15.899155 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cf738-d637-47b1-bd0f-55c7cf69daf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:15.905429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:15.918805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-497cf738-d637-47b1-bd0f-55c7cf69daf9 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:15.923375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-497cf738-d637-47b1-bd0f-55c7cf69daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:15.995620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 503/1003] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:16.274826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad9ccd-78c5-4e50-8762-5dffa17cb61a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:16.310190 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:16.427279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad9ccd-78c5-4e50-8762-5dffa17cb61a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:16.473943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50405f46-c3ec-48d9-ad56-607612686520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:16.474559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50405f46-c3ec-48d9-ad56-607612686520 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:16.474836 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50405f46-c3ec-48d9-ad56-607612686520 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:16.475110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50405f46-c3ec-48d9-ad56-607612686520 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:16.475786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50405f46-c3ec-48d9-ad56-607612686520 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:16.477185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50405f46-c3ec-48d9-ad56-607612686520 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:16.588358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 501/1004] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:59:16 2022] POST /identity/v3/services => generated 242 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 11:59:16.691998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8e096-ed43-4b99-9f9c-cbe65333e998 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:16.692436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8e096-ed43-4b99-9f9c-cbe65333e998 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:16.692585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8e096-ed43-4b99-9f9c-cbe65333e998 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:16.694243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 504/1005] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:16.699813 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83197-ead9-47f4-80d9-f8598d612262 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:16.700078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83197-ead9-47f4-80d9-f8598d612262 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:16.700444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83197-ead9-47f4-80d9-f8598d612262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:16.722587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5bd83197-ead9-47f4-80d9-f8598d612262 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:16.723835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5bd83197-ead9-47f4-80d9-f8598d612262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:16.824309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 502/1006] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:17.095222 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8e096-ed43-4b99-9f9c-cbe65333e998 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:17.274342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8e096-ed43-4b99-9f9c-cbe65333e998 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:17.328449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:17.337317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180262a-7dfc-4b70-926a-21805c017142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:17.344761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180262a-7dfc-4b70-926a-21805c017142 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:17.344761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180262a-7dfc-4b70-926a-21805c017142 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:17.344761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180262a-7dfc-4b70-926a-21805c017142 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:17.344761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180262a-7dfc-4b70-926a-21805c017142 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:17.344761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180262a-7dfc-4b70-926a-21805c017142 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-2180262a-7dfc-4b70-926a-21805c017142 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:17.359882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:17.361190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 11:59:17.362143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:17.363413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 505/1007] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Sep 1 11:59:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:17.370408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83197-ead9-47f4-80d9-f8598d612262 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:17.398295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:17.447437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f768b0-6155-430e-8770-f3d3d094c9df None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:17.447723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f768b0-6155-430e-8770-f3d3d094c9df None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:17.447980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f768b0-6155-430e-8770-f3d3d094c9df None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:17.449788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 506/1008] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:17.456311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29e0b7-de0c-4776-9bfb-b6e1e888007e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:17.456722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29e0b7-de0c-4776-9bfb-b6e1e888007e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:17.456878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29e0b7-de0c-4776-9bfb-b6e1e888007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:17.475982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ec29e0b7-de0c-4776-9bfb-b6e1e888007e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:17.477226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ec29e0b7-de0c-4776-9bfb-b6e1e888007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:17.540867 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83197-ead9-47f4-80d9-f8598d612262 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:17.558874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 507/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:17 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:17.587175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f12205-7cae-48f7-8edd-52f21868b4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:17.588174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f12205-7cae-48f7-8edd-52f21868b4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:17.588765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f12205-7cae-48f7-8edd-52f21868b4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:17.589229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f12205-7cae-48f7-8edd-52f21868b4a8 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:17.589988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f12205-7cae-48f7-8edd-52f21868b4a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:17.590418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f12205-7cae-48f7-8edd-52f21868b4a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:17.591912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f12205-7cae-48f7-8edd-52f21868b4a8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:17.599749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 503/1010] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 1 11:59:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:17.606886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29e0b7-de0c-4776-9bfb-b6e1e888007e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:17.786261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29e0b7-de0c-4776-9bfb-b6e1e888007e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:17.824366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f12205-7cae-48f7-8edd-52f21868b4a8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:17.833585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:17.843625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eff9cf-3dbf-4eb5-8fd1-c5c27dc4ca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:17.844354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eff9cf-3dbf-4eb5-8fd1-c5c27dc4ca3b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:17.844697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eff9cf-3dbf-4eb5-8fd1-c5c27dc4ca3b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:17.845027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eff9cf-3dbf-4eb5-8fd1-c5c27dc4ca3b None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:17.845739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eff9cf-3dbf-4eb5-8fd1-c5c27dc4ca3b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:17.847714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eff9cf-3dbf-4eb5-8fd1-c5c27dc4ca3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:17.848095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eff9cf-3dbf-4eb5-8fd1-c5c27dc4ca3b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:17.853739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 508/1011] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Sep 1 11:59:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:17.859624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eff9cf-3dbf-4eb5-8fd1-c5c27dc4ca3b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:17.920695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:17.953229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f12205-7cae-48f7-8edd-52f21868b4a8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:17.994980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eff9cf-3dbf-4eb5-8fd1-c5c27dc4ca3b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:18.016515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f8e1c-e982-4be0-a062-1e98bb36cc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:18.017562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8e1c-e982-4be0-a062-1e98bb36cc39 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:18.018068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8e1c-e982-4be0-a062-1e98bb36cc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:18.018720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8e1c-e982-4be0-a062-1e98bb36cc39 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:18.020523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f8e1c-e982-4be0-a062-1e98bb36cc39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:18.022669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f8e1c-e982-4be0-a062-1e98bb36cc39 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:18.031217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3370d-fd6e-444f-8ce9-8d439a86bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:18.031829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3370d-fd6e-444f-8ce9-8d439a86bb54 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:18.032128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3370d-fd6e-444f-8ce9-8d439a86bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:18.032409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3370d-fd6e-444f-8ce9-8d439a86bb54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:18.033167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3370d-fd6e-444f-8ce9-8d439a86bb54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:18.034439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3370d-fd6e-444f-8ce9-8d439a86bb54 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0d3f8e1c-e982-4be0-a062-1e98bb36cc39 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:18.040291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:18.041315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 11:59:18.042230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:18.042952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 504/1012] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:59:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:18.049530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f8e1c-e982-4be0-a062-1e98bb36cc39 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:18.169244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f8e1c-e982-4be0-a062-1e98bb36cc39 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:18.180772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 509/1013] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 11:59:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 11:59:18.252811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892b1b4-364a-42a0-87e9-9481e8d38755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:18.253809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892b1b4-364a-42a0-87e9-9481e8d38755 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:18.254246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892b1b4-364a-42a0-87e9-9481e8d38755 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:18.254709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892b1b4-364a-42a0-87e9-9481e8d38755 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:18.255863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892b1b4-364a-42a0-87e9-9481e8d38755 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:18.256438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892b1b4-364a-42a0-87e9-9481e8d38755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:18.259178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892b1b4-364a-42a0-87e9-9481e8d38755 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:18.270012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 505/1014] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:59:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:18.279326 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3370d-fd6e-444f-8ce9-8d439a86bb54 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:18.364793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:18.436105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3370d-fd6e-444f-8ce9-8d439a86bb54 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:18.479765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac323a-3093-49d4-80e0-0e8fffcd0903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:18.480585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac323a-3093-49d4-80e0-0e8fffcd0903 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:18.480966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac323a-3093-49d4-80e0-0e8fffcd0903 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:18.481144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac323a-3093-49d4-80e0-0e8fffcd0903 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:18.481866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac323a-3093-49d4-80e0-0e8fffcd0903 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:18.482311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac323a-3093-49d4-80e0-0e8fffcd0903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:18.484045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac323a-3093-49d4-80e0-0e8fffcd0903 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:18.490927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 510/1015] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Sep 1 11:59:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:18.499621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892b1b4-364a-42a0-87e9-9481e8d38755 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:18.503271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:18.606214 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf67b-abe7-49ef-9d94-f13a771cf2f6 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:18.606551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf67b-abe7-49ef-9d94-f13a771cf2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:18.606767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf67b-abe7-49ef-9d94-f13a771cf2f6 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:18.608372 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 511/1016] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:18.613656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f772c-d01a-4de1-8e98-2a22fcad4ddf None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:18.613940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f772c-d01a-4de1-8e98-2a22fcad4ddf None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:18.614221 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f772c-d01a-4de1-8e98-2a22fcad4ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:18.634373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6f6f772c-d01a-4de1-8e98-2a22fcad4ddf None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:18.635673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6f6f772c-d01a-4de1-8e98-2a22fcad4ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:18.659003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892b1b4-364a-42a0-87e9-9481e8d38755 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:18.712521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e550f37-302b-4553-9f0b-262e89f6dfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:18.713149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550f37-302b-4553-9f0b-262e89f6dfe3 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:18.713422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550f37-302b-4553-9f0b-262e89f6dfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:18.713686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e550f37-302b-4553-9f0b-262e89f6dfe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:18.714407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e550f37-302b-4553-9f0b-262e89f6dfe3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:18.715862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e550f37-302b-4553-9f0b-262e89f6dfe3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:18.742603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 512/1017] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:18 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:18.815672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 506/1018] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 11:59:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 11:59:19.024517 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f772c-d01a-4de1-8e98-2a22fcad4ddf None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:19.085136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:19.165029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f772c-d01a-4de1-8e98-2a22fcad4ddf None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:19.211705 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c4ead-3315-4b24-994b-c197d36f854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:19.212509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c4ead-3315-4b24-994b-c197d36f854e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:19.212769 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c4ead-3315-4b24-994b-c197d36f854e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:19.212930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c4ead-3315-4b24-994b-c197d36f854e None admin] PATH_INFO: `/v3/services/image` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:19.213534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c4ead-3315-4b24-994b-c197d36f854e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:19.214931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c4ead-3315-4b24-994b-c197d36f854e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-bf1c4ead-3315-4b24-994b-c197d36f854e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:19.225289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:19.227636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:19.229708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 513/1019] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Sep 1 11:59:19 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:19.233638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e550f37-302b-4553-9f0b-262e89f6dfe3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:19.337539 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:19.407891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e550f37-302b-4553-9f0b-262e89f6dfe3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:19.464973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361a206-701c-4613-a924-868f19c8324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:19.465995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361a206-701c-4613-a924-868f19c8324e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:19.466491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361a206-701c-4613-a924-868f19c8324e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:19.466995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361a206-701c-4613-a924-868f19c8324e None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:19.468094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361a206-701c-4613-a924-868f19c8324e None admin] RBAC: Adding query filter params (name=image) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:19.468647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361a206-701c-4613-a924-868f19c8324e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:19.471293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361a206-701c-4613-a924-868f19c8324e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:19.487138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 507/1020] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:19.489602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c4ead-3315-4b24-994b-c197d36f854e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:19.651285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c4ead-3315-4b24-994b-c197d36f854e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:19.655272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:19.691905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313fefb-0ad7-47a6-93d7-a69e4357168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:19.692562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313fefb-0ad7-47a6-93d7-a69e4357168f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:19.692936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313fefb-0ad7-47a6-93d7-a69e4357168f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:19.693139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313fefb-0ad7-47a6-93d7-a69e4357168f None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:19.693763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313fefb-0ad7-47a6-93d7-a69e4357168f None admin] RBAC: Adding query filter params (type=image) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:19.694468 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313fefb-0ad7-47a6-93d7-a69e4357168f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:19.696611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313fefb-0ad7-47a6-93d7-a69e4357168f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:19.707209 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 514/1021] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:19.709121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361a206-701c-4613-a924-868f19c8324e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:19.820245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361a206-701c-4613-a924-868f19c8324e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:19.846894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:19.860282 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6b7ba-a25d-4896-90ff-e527b7080e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:19.860911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6b7ba-a25d-4896-90ff-e527b7080e0c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:19.861196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6b7ba-a25d-4896-90ff-e527b7080e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:19.861443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6b7ba-a25d-4896-90ff-e527b7080e0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:19.862164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6b7ba-a25d-4896-90ff-e527b7080e0c None admin] RBAC: Adding query filter params (interface=public, service_id=c6397f8309d54845ac3e2b09650d3c58, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:19.862573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6b7ba-a25d-4896-90ff-e527b7080e0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:19.864474 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6b7ba-a25d-4896-90ff-e527b7080e0c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:19.870258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 508/1022] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 1 11:59:19 2022] GET /identity/v3/endpoints?service_id=c6397f8309d54845ac3e2b09650d3c58&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:19.875895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313fefb-0ad7-47a6-93d7-a69e4357168f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:19.989626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313fefb-0ad7-47a6-93d7-a69e4357168f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:20.027257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86328a95-908a-4387-b133-890c59b7b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:20.027868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86328a95-908a-4387-b133-890c59b7b85b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:20.028156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86328a95-908a-4387-b133-890c59b7b85b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:20.028460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86328a95-908a-4387-b133-890c59b7b85b None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:20.029043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86328a95-908a-4387-b133-890c59b7b85b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:20.030403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86328a95-908a-4387-b133-890c59b7b85b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:20.044490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 515/1023] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 1 11:59:19 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 11:59:20.211153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183a377-0c76-4087-a1b2-c580a6f58c3e None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:20.211153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183a377-0c76-4087-a1b2-c580a6f58c3e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:20.211153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183a377-0c76-4087-a1b2-c580a6f58c3e None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:20.211988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 509/1024] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:20.217721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eee27-19ea-46eb-b40c-aed8efa21331 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:20.218213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eee27-19ea-46eb-b40c-aed8efa21331 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:20.218313 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eee27-19ea-46eb-b40c-aed8efa21331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:20.238816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-cd9eee27-19ea-46eb-b40c-aed8efa21331 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:20.240092 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cd9eee27-19ea-46eb-b40c-aed8efa21331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:20.268799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:20.339453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 516/1025] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:20.626738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183a377-0c76-4087-a1b2-c580a6f58c3e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:20.788478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183a377-0c76-4087-a1b2-c580a6f58c3e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:20.844858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cd61f-6245-4c3c-9dc8-ad8f33ec0a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:20.845921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd61f-6245-4c3c-9dc8-ad8f33ec0a5d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:20.846420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd61f-6245-4c3c-9dc8-ad8f33ec0a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:20.846919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd61f-6245-4c3c-9dc8-ad8f33ec0a5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:20.849407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cd61f-6245-4c3c-9dc8-ad8f33ec0a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:20.851867 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cd61f-6245-4c3c-9dc8-ad8f33ec0a5d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:20.856284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 510/1026] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:20.861700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eee27-19ea-46eb-b40c-aed8efa21331 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:20.989237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eee27-19ea-46eb-b40c-aed8efa21331 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:21.027845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffa4ba-2ac2-4dca-a44e-f3696971d573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:21.028502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa4ba-2ac2-4dca-a44e-f3696971d573 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:21.028778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa4ba-2ac2-4dca-a44e-f3696971d573 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:21.029049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa4ba-2ac2-4dca-a44e-f3696971d573 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:21.029701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffa4ba-2ac2-4dca-a44e-f3696971d573 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:21.031119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffa4ba-2ac2-4dca-a44e-f3696971d573 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:21.155525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 517/1027] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:59:20 2022] POST /identity/v3/projects => generated 311 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:59:22.028811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78003-e3a1-4c46-9349-4b853afae910 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:22.029403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78003-e3a1-4c46-9349-4b853afae910 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:22.029403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78003-e3a1-4c46-9349-4b853afae910 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:22.030744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 511/1028] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:22.036509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7631990-6506-43b0-9b30-106ed6f14c96 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:22.036953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7631990-6506-43b0-9b30-106ed6f14c96 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:22.037054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7631990-6506-43b0-9b30-106ed6f14c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:22.055653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a7631990-6506-43b0-9b30-106ed6f14c96 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:22.056876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a7631990-6506-43b0-9b30-106ed6f14c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:22.067941 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:22.131342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 518/1029] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:22.253544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361393d-fdac-40fa-97b7-1ca6b81550d8 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:22.253975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361393d-fdac-40fa-97b7-1ca6b81550d8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:22.254133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361393d-fdac-40fa-97b7-1ca6b81550d8 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:22.255802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 512/1030] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:22.262312 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ee4b-f64f-450b-9d7a-d5a408c6483f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:22.262822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ee4b-f64f-450b-9d7a-d5a408c6483f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:22.263329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ee4b-f64f-450b-9d7a-d5a408c6483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:22.291777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f3f3ee4b-f64f-450b-9d7a-d5a408c6483f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:22.293599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f3f3ee4b-f64f-450b-9d7a-d5a408c6483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:22.383093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 519/1031] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:22.397745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361393d-fdac-40fa-97b7-1ca6b81550d8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:22.468141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:22.520507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361393d-fdac-40fa-97b7-1ca6b81550d8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:22.560640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dbbf8-2183-4bb0-b05e-520d8dede0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:22.561374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dbbf8-2183-4bb0-b05e-520d8dede0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:22.561774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dbbf8-2183-4bb0-b05e-520d8dede0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:22.562179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dbbf8-2183-4bb0-b05e-520d8dede0e0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:22.562971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dbbf8-2183-4bb0-b05e-520d8dede0e0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:22.564581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dbbf8-2183-4bb0-b05e-520d8dede0e0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e87dbbf8-2183-4bb0-b05e-520d8dede0e0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:22.574660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:22.576584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 11:59:22.578180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:22.583553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 513/1032] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Sep 1 11:59:22 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:22.584934 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3ee4b-f64f-450b-9d7a-d5a408c6483f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:22.668369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dbbf8-2183-4bb0-b05e-520d8dede0e0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:22.670865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:22.701162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3ee4b-f64f-450b-9d7a-d5a408c6483f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:22.744242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c39c78-0221-44e1-923f-8d275dcb26a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:22.744896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c39c78-0221-44e1-923f-8d275dcb26a0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:22.745315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c39c78-0221-44e1-923f-8d275dcb26a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:22.745689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c39c78-0221-44e1-923f-8d275dcb26a0 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:22.746210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c39c78-0221-44e1-923f-8d275dcb26a0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:22.746521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c39c78-0221-44e1-923f-8d275dcb26a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:22.747995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c39c78-0221-44e1-923f-8d275dcb26a0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:22.758298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 520/1033] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:22.760198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c39c78-0221-44e1-923f-8d275dcb26a0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:22.791628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dbbf8-2183-4bb0-b05e-520d8dede0e0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:22.811885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:22.829275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a28b9-1fa1-404d-905d-50c4ebbbc309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:22.829917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a28b9-1fa1-404d-905d-50c4ebbbc309 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:22.830196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a28b9-1fa1-404d-905d-50c4ebbbc309 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:22.830466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a28b9-1fa1-404d-905d-50c4ebbbc309 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:22.844244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a28b9-1fa1-404d-905d-50c4ebbbc309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b59a28b9-1fa1-404d-905d-50c4ebbbc309 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:59:22.850132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:22.851327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:22.853038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 514/1034] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 1 11:59:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:22.857811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a28b9-1fa1-404d-905d-50c4ebbbc309 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:22.885100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c39c78-0221-44e1-923f-8d275dcb26a0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:22.923075 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfdbba-8fd8-4cce-9f08-308f65115411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:22.923697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfdbba-8fd8-4cce-9f08-308f65115411 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:22.923966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfdbba-8fd8-4cce-9f08-308f65115411 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:22.924271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfdbba-8fd8-4cce-9f08-308f65115411 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:22.925065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfdbba-8fd8-4cce-9f08-308f65115411 None admin] RBAC: Adding query filter params (type=image) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:22.925828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfdbba-8fd8-4cce-9f08-308f65115411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:22.927209 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfdbba-8fd8-4cce-9f08-308f65115411 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:22.933107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 521/1035] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:22.942136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfdbba-8fd8-4cce-9f08-308f65115411 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:22.945151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:22.991747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a28b9-1fa1-404d-905d-50c4ebbbc309 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:23.042164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8e884-d08c-41f0-9f8c-27005041534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:23.043425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8e884-d08c-41f0-9f8c-27005041534a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:23.043926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8e884-d08c-41f0-9f8c-27005041534a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:23.044486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8e884-d08c-41f0-9f8c-27005041534a None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:23.045418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8e884-d08c-41f0-9f8c-27005041534a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:23.045982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8e884-d08c-41f0-9f8c-27005041534a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:23.048604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8e884-d08c-41f0-9f8c-27005041534a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:23.060423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 515/1036] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 1 11:59:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:23.066889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8e884-d08c-41f0-9f8c-27005041534a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:23.082008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfdbba-8fd8-4cce-9f08-308f65115411 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:23.122801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24c419-da0d-40c7-bf1f-84da8ca02be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:23.123421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24c419-da0d-40c7-bf1f-84da8ca02be4 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:23.123702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24c419-da0d-40c7-bf1f-84da8ca02be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:23.124038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24c419-da0d-40c7-bf1f-84da8ca02be4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:23.124771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24c419-da0d-40c7-bf1f-84da8ca02be4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:23.126229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24c419-da0d-40c7-bf1f-84da8ca02be4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:23.126470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:23.200286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 522/1037] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 11:59:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 11:59:23.219777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8e884-d08c-41f0-9f8c-27005041534a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:23.281444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c6fab-eba4-49af-bc89-5f2781e5b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:23.282185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c6fab-eba4-49af-bc89-5f2781e5b1aa None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:23.282473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c6fab-eba4-49af-bc89-5f2781e5b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:23.282773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c6fab-eba4-49af-bc89-5f2781e5b1aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:23.288893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061cb96-c882-4ce7-9f13-8b02d8310adf None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:23.289286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061cb96-c882-4ce7-9f13-8b02d8310adf None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:23.289442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061cb96-c882-4ce7-9f13-8b02d8310adf None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:23.291124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 523/1038] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:23.296986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aedca8-4bfc-4a29-94bd-ccf073952cff None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:23.297287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aedca8-4bfc-4a29-94bd-ccf073952cff None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:23.297553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aedca8-4bfc-4a29-94bd-ccf073952cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:23.300527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c6fab-eba4-49af-bc89-5f2781e5b1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:23.302396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c6fab-eba4-49af-bc89-5f2781e5b1aa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:23.319085 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-86aedca8-4bfc-4a29-94bd-ccf073952cff None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:23.320259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-86aedca8-4bfc-4a29-94bd-ccf073952cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7d5c6fab-eba4-49af-bc89-5f2781e5b1aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:23.323761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:23.324841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:23.325738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:23.325738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:23.325738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:23.325738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 516/1039] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:23.332630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c6fab-eba4-49af-bc89-5f2781e5b1aa None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:23.400029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:23.416818 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 524/1040] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:23.456081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:23.470456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c6fab-eba4-49af-bc89-5f2781e5b1aa None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:23.519609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f28507-da1f-4559-b998-94867f838cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:23.520544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f28507-da1f-4559-b998-94867f838cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:23.520860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f28507-da1f-4559-b998-94867f838cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:23.521564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f28507-da1f-4559-b998-94867f838cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:23.522486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f28507-da1f-4559-b998-94867f838cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:23.522894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f28507-da1f-4559-b998-94867f838cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:23.524665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f28507-da1f-4559-b998-94867f838cb5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:23.542316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 517/1041] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:23.548999 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aedca8-4bfc-4a29-94bd-ccf073952cff None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:23.701109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aedca8-4bfc-4a29-94bd-ccf073952cff None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:23.708624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f28507-da1f-4559-b998-94867f838cb5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:23.758425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f796c-2f8c-4745-aa44-d004e96c6deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:23.759090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f796c-2f8c-4745-aa44-d004e96c6deb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:23.759369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f796c-2f8c-4745-aa44-d004e96c6deb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:23.760672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f796c-2f8c-4745-aa44-d004e96c6deb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:23.768544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f796c-2f8c-4745-aa44-d004e96c6deb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:23.770047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f796c-2f8c-4745-aa44-d004e96c6deb None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-101f796c-2f8c-4745-aa44-d004e96c6deb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:59:23.783527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:23.785467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:23.786778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 525/1042] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 1 11:59:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:23.795295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f796c-2f8c-4745-aa44-d004e96c6deb None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:23.867307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f28507-da1f-4559-b998-94867f838cb5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:23.874724 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:23.911872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9558-2a8d-4a8d-a8cf-cacafada600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:23.912580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9558-2a8d-4a8d-a8cf-cacafada600c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:23.912842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9558-2a8d-4a8d-a8cf-cacafada600c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:23.913108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9558-2a8d-4a8d-a8cf-cacafada600c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:23.914257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a9558-2a8d-4a8d-a8cf-cacafada600c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:23.915759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a9558-2a8d-4a8d-a8cf-cacafada600c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:23.923006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 518/1043] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:23.923683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9558-2a8d-4a8d-a8cf-cacafada600c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:23.943451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f796c-2f8c-4745-aa44-d004e96c6deb None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:23.948589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:23.990924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cea7ce-90b2-460f-b8a9-e87e46fca1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:23.996526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea7ce-90b2-460f-b8a9-e87e46fca1dd None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:23.996898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea7ce-90b2-460f-b8a9-e87e46fca1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:23.997168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea7ce-90b2-460f-b8a9-e87e46fca1dd None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:23.997982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cea7ce-90b2-460f-b8a9-e87e46fca1dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:23.998289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cea7ce-90b2-460f-b8a9-e87e46fca1dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:23.999756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cea7ce-90b2-460f-b8a9-e87e46fca1dd None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:24.025707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 526/1044] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 1 11:59:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:24.031876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cea7ce-90b2-460f-b8a9-e87e46fca1dd None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:24.054976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9558-2a8d-4a8d-a8cf-cacafada600c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:24.106120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054e68-79f5-4b35-bf2f-ef0aaf0a1db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:24.107122 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054e68-79f5-4b35-bf2f-ef0aaf0a1db6 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:24.107651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054e68-79f5-4b35-bf2f-ef0aaf0a1db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:24.108601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054e68-79f5-4b35-bf2f-ef0aaf0a1db6 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:24.109767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43054e68-79f5-4b35-bf2f-ef0aaf0a1db6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:24.111954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43054e68-79f5-4b35-bf2f-ef0aaf0a1db6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:24.157467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cea7ce-90b2-460f-b8a9-e87e46fca1dd None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:24.166509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:24.194994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5178c-6d93-4f38-92d3-c2f2025c088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:24.195761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5178c-6d93-4f38-92d3-c2f2025c088e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:24.196304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5178c-6d93-4f38-92d3-c2f2025c088e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:24.196805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5178c-6d93-4f38-92d3-c2f2025c088e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:24.240262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 519/1045] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:59:23 2022] POST /identity/v3/users => generated 285 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 11:59:24.313028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5178c-6d93-4f38-92d3-c2f2025c088e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:24.314579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5178c-6d93-4f38-92d3-c2f2025c088e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:24.466595 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 527/1046] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:59:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 11:59:24.473163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054e68-79f5-4b35-bf2f-ef0aaf0a1db6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:24.562180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:24.614150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054e68-79f5-4b35-bf2f-ef0aaf0a1db6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:24.669752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2552c8-54bf-466e-9864-55341cd96355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:24.670407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2552c8-54bf-466e-9864-55341cd96355 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:24.670687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2552c8-54bf-466e-9864-55341cd96355 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:24.670961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2552c8-54bf-466e-9864-55341cd96355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:24.683752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2552c8-54bf-466e-9864-55341cd96355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:24.685806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2552c8-54bf-466e-9864-55341cd96355 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ed2552c8-54bf-466e-9864-55341cd96355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:24.702868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:24.705204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:24.707262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:24.707262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:24.707262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:24.708305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 520/1047] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:24.710834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5178c-6d93-4f38-92d3-c2f2025c088e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:24.722323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:24.873296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5178c-6d93-4f38-92d3-c2f2025c088e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:24.913482 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214debf6-fa63-414d-9fab-a2eacf689686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:24.914096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214debf6-fa63-414d-9fab-a2eacf689686 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:24.914373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214debf6-fa63-414d-9fab-a2eacf689686 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:24.914642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214debf6-fa63-414d-9fab-a2eacf689686 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:24.915289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214debf6-fa63-414d-9fab-a2eacf689686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:24.915594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214debf6-fa63-414d-9fab-a2eacf689686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:24.916996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214debf6-fa63-414d-9fab-a2eacf689686 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:24.935674 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 528/1048] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:24.937524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2552c8-54bf-466e-9864-55341cd96355 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:25.052516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2552c8-54bf-466e-9864-55341cd96355 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:25.079103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:25.093295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747789b5-320f-474f-bc7b-8c8e89ff8184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:25.093949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747789b5-320f-474f-bc7b-8c8e89ff8184 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:25.094230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747789b5-320f-474f-bc7b-8c8e89ff8184 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:25.095525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747789b5-320f-474f-bc7b-8c8e89ff8184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:25.103259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747789b5-320f-474f-bc7b-8c8e89ff8184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:25.104785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747789b5-320f-474f-bc7b-8c8e89ff8184 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-747789b5-320f-474f-bc7b-8c8e89ff8184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:59:25.118602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:25.120019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:25.122328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:59:25.122328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:59:25.122328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:59:25.122328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:59:25.122328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:59:25.122328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:59:25.122328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:25.122328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:25.127114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 521/1049] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:25.131636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214debf6-fa63-414d-9fab-a2eacf689686 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:25.244545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:25.266548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184273c-217c-4052-a7a9-e61dcd2bb985 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:25.266829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184273c-217c-4052-a7a9-e61dcd2bb985 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:25.267106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184273c-217c-4052-a7a9-e61dcd2bb985 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:25.268647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 522/1050] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:25.274558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104c009-6ba0-49b2-b332-dff0920a97ca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:25.274785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104c009-6ba0-49b2-b332-dff0920a97ca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:25.274951 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104c009-6ba0-49b2-b332-dff0920a97ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:25.294140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214debf6-fa63-414d-9fab-a2eacf689686 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:25.298471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f104c009-6ba0-49b2-b332-dff0920a97ca None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:25.300529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f104c009-6ba0-49b2-b332-dff0920a97ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:25.339138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbef1b-d798-4c7a-acc7-7a576ea92779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:25.339841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbef1b-d798-4c7a-acc7-7a576ea92779 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:25.340135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbef1b-d798-4c7a-acc7-7a576ea92779 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:25.340448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbef1b-d798-4c7a-acc7-7a576ea92779 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:25.341347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbef1b-d798-4c7a-acc7-7a576ea92779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:25.341864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbef1b-d798-4c7a-acc7-7a576ea92779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:25.344094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbef1b-d798-4c7a-acc7-7a576ea92779 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:25.360271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 529/1051] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:59:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:25.367778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbef1b-d798-4c7a-acc7-7a576ea92779 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:25.391547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 523/1052] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:25.538584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbef1b-d798-4c7a-acc7-7a576ea92779 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:25.571172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:25.581348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059fc4f-2397-4021-8b6e-256fcd908f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:25.591168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059fc4f-2397-4021-8b6e-256fcd908f1a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:25.591168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059fc4f-2397-4021-8b6e-256fcd908f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:25.591168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059fc4f-2397-4021-8b6e-256fcd908f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:25.591168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059fc4f-2397-4021-8b6e-256fcd908f1a None admin] RBAC: Adding query filter params (role.id=66ad504049f14c468b41216dbc3285a4, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=7790d6ec0e524ee6a31fd06fda9c4ac7) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:25.591168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059fc4f-2397-4021-8b6e-256fcd908f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:25.591168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059fc4f-2397-4021-8b6e-256fcd908f1a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:25.596827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 530/1053] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:59:25 2022] GET /identity/v3/role_assignments?user.id=7790d6ec0e524ee6a31fd06fda9c4ac7&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=66ad504049f14c468b41216dbc3285a4 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:25.669657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104c009-6ba0-49b2-b332-dff0920a97ca None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:25.809869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104c009-6ba0-49b2-b332-dff0920a97ca None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:25.830658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:25.856775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec504c4-8faf-49f6-832c-6250ce2ae06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:25.857284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec504c4-8faf-49f6-832c-6250ce2ae06b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:25.857564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec504c4-8faf-49f6-832c-6250ce2ae06b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:25.857835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec504c4-8faf-49f6-832c-6250ce2ae06b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:25.942881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec504c4-8faf-49f6-832c-6250ce2ae06b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:25.944631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec504c4-8faf-49f6-832c-6250ce2ae06b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:26.068292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 524/1054] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:59:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 11:59:26.074129 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059fc4f-2397-4021-8b6e-256fcd908f1a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:26.197188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059fc4f-2397-4021-8b6e-256fcd908f1a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:26.236107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dec44-33f3-47d0-ab51-31381135ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:26.236777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dec44-33f3-47d0-ab51-31381135ab89 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:26.237062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dec44-33f3-47d0-ab51-31381135ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:26.238032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dec44-33f3-47d0-ab51-31381135ab89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:26.249836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dec44-33f3-47d0-ab51-31381135ab89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:26.251318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dec44-33f3-47d0-ab51-31381135ab89 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-622dec44-33f3-47d0-ab51-31381135ab89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:26.267128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:26.276803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:26.278651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:26.278651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:26.278651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:26.278651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 531/1055] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:26.282246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec504c4-8faf-49f6-832c-6250ce2ae06b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:26.312265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:26.439069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec504c4-8faf-49f6-832c-6250ce2ae06b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:26.446160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5d28-27da-4177-9adb-9723db9b38ad None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:26.446607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5d28-27da-4177-9adb-9723db9b38ad None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:26.447018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5d28-27da-4177-9adb-9723db9b38ad None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:26.448860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 532/1056] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 11:59:26.455168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90355d7-846f-44eb-8c4a-a7a32fab98f7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:26.455474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90355d7-846f-44eb-8c4a-a7a32fab98f7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:26.455721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90355d7-846f-44eb-8c4a-a7a32fab98f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:26.475612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f90355d7-846f-44eb-8c4a-a7a32fab98f7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:26.476875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f90355d7-846f-44eb-8c4a-a7a32fab98f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:26.490850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc5121-a1ff-4360-a5a8-2c7ee2bb2ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:26.491596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5121-a1ff-4360-a5a8-2c7ee2bb2ecf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:26.491882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5121-a1ff-4360-a5a8-2c7ee2bb2ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:26.492153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5121-a1ff-4360-a5a8-2c7ee2bb2ecf None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:26.492894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc5121-a1ff-4360-a5a8-2c7ee2bb2ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:26.493200 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc5121-a1ff-4360-a5a8-2c7ee2bb2ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:26.494612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc5121-a1ff-4360-a5a8-2c7ee2bb2ecf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:26.509665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 525/1057] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:26.525478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:26.568477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 533/1058] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:26.839936 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc5121-a1ff-4360-a5a8-2c7ee2bb2ecf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:26.950621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:26.976604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc5121-a1ff-4360-a5a8-2c7ee2bb2ecf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:27.015025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b96f-23e2-4793-8c97-2f62782570f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:27.015845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b96f-23e2-4793-8c97-2f62782570f0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:27.016125 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b96f-23e2-4793-8c97-2f62782570f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:27.016460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b96f-23e2-4793-8c97-2f62782570f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:27.035052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877b96f-23e2-4793-8c97-2f62782570f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c877b96f-23e2-4793-8c97-2f62782570f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:59:27.045605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:27.046548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:59:27.047385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:27.048571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 526/1059] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:27.056800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90355d7-846f-44eb-8c4a-a7a32fab98f7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:27.169183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90355d7-846f-44eb-8c4a-a7a32fab98f7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:27.207862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae890741-a20a-4e98-beaa-6dddd89cb897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:27.208523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae890741-a20a-4e98-beaa-6dddd89cb897 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:27.208801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae890741-a20a-4e98-beaa-6dddd89cb897 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:27.209070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae890741-a20a-4e98-beaa-6dddd89cb897 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:27.209775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae890741-a20a-4e98-beaa-6dddd89cb897 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:27.210076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae890741-a20a-4e98-beaa-6dddd89cb897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:27.211488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae890741-a20a-4e98-beaa-6dddd89cb897 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:27.221170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 534/1060] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:27.227803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b96f-23e2-4793-8c97-2f62782570f0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:27.352990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b96f-23e2-4793-8c97-2f62782570f0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:27.390092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cda83-39f9-4416-8095-4dd1095564af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:27.390725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cda83-39f9-4416-8095-4dd1095564af None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:27.391000 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cda83-39f9-4416-8095-4dd1095564af None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:27.391271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cda83-39f9-4416-8095-4dd1095564af None admin] PATH_INFO: `/v3/users/4c9d442bf7724a3dbe6db83a044613a6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:27.393391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:27.406733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cda83-39f9-4416-8095-4dd1095564af None admin] RBAC: Authorizing `identity:get_user(user_id=4c9d442bf7724a3dbe6db83a044613a6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:27.414448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cda83-39f9-4416-8095-4dd1095564af None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:27.414448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 527/1061] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:27 2022] GET /identity/v3/users/4c9d442bf7724a3dbe6db83a044613a6 => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:27.420394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae890741-a20a-4e98-beaa-6dddd89cb897 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:27.458042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:27.530304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae890741-a20a-4e98-beaa-6dddd89cb897 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:27.569022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4888-6ff4-4023-9856-7c68a145649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:27.569581 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4888-6ff4-4023-9856-7c68a145649a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:27.569771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4888-6ff4-4023-9856-7c68a145649a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:27.570046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4888-6ff4-4023-9856-7c68a145649a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:27.641021 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c4888-6ff4-4023-9856-7c68a145649a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:27.642514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c4888-6ff4-4023-9856-7c68a145649a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:27.680631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:27.686473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f94c-9533-4606-87ae-9b6f08a9d65f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:27.687283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f94c-9533-4606-87ae-9b6f08a9d65f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:27.687283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f94c-9533-4606-87ae-9b6f08a9d65f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:27.692267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 528/1062] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:27.717650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdc45e-8aae-45eb-8048-3693b5ec1e10 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:27.717650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdc45e-8aae-45eb-8048-3693b5ec1e10 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:27.717650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdc45e-8aae-45eb-8048-3693b5ec1e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:27.717650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d8bdc45e-8aae-45eb-8048-3693b5ec1e10 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:27.717650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d8bdc45e-8aae-45eb-8048-3693b5ec1e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:27.758539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 535/1063] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:59:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 11:59:27.764855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4888-6ff4-4023-9856-7c68a145649a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:27.794927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 529/1064] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:27.914469 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4888-6ff4-4023-9856-7c68a145649a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:27.970662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e7e77-31e4-4a5e-b858-d1b4c70b1a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:27.972247 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e7e77-31e4-4a5e-b858-d1b4c70b1a0b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:27.972732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e7e77-31e4-4a5e-b858-d1b4c70b1a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:27.973194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e7e77-31e4-4a5e-b858-d1b4c70b1a0b None admin] PATH_INFO: `/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:27.975119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e7e77-31e4-4a5e-b858-d1b4c70b1a0b None admin] RBAC: Authorizing `identity:get_project(project_id=0d79408ea3fb4fcdacfe59ef7919256c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:27.977840 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e7e77-31e4-4a5e-b858-d1b4c70b1a0b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:27.985883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 536/1065] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:59:27 2022] GET /identity/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c => generated 311 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:27.987231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdc45e-8aae-45eb-8048-3693b5ec1e10 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:28.090969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdc45e-8aae-45eb-8048-3693b5ec1e10 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:28.114744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:28.127673 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf40631-eb4c-453c-989d-0828a3a90163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:28.130421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf40631-eb4c-453c-989d-0828a3a90163 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:28.130421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf40631-eb4c-453c-989d-0828a3a90163 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:28.130421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf40631-eb4c-453c-989d-0828a3a90163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:28.130421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf40631-eb4c-453c-989d-0828a3a90163 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=0d79408ea3fb4fcdacfe59ef7919256c, user.id=4c9d442bf7724a3dbe6db83a044613a6) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:28.130421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf40631-eb4c-453c-989d-0828a3a90163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:28.131867 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf40631-eb4c-453c-989d-0828a3a90163 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:28.137686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 530/1066] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:59:27 2022] GET /identity/v3/role_assignments?user.id=4c9d442bf7724a3dbe6db83a044613a6&scope.project.id=0d79408ea3fb4fcdacfe59ef7919256c&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:28.152317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e7e77-31e4-4a5e-b858-d1b4c70b1a0b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:28.155608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:28.270876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e7e77-31e4-4a5e-b858-d1b4c70b1a0b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:28.307508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc2c62-b2e6-4bc5-981b-2a18d58d0843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:28.308146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc2c62-b2e6-4bc5-981b-2a18d58d0843 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:28.308484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc2c62-b2e6-4bc5-981b-2a18d58d0843 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:28.308758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc2c62-b2e6-4bc5-981b-2a18d58d0843 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:28.319962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc2c62-b2e6-4bc5-981b-2a18d58d0843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-1ccc2c62-b2e6-4bc5-981b-2a18d58d0843 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:59:28.325329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:28.326401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:28.327231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 537/1067] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 1 11:59:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:28.332929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf40631-eb4c-453c-989d-0828a3a90163 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:28.437217 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf40631-eb4c-453c-989d-0828a3a90163 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:28.474332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d325dd7-4173-43b3-8319-f865999fbe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:28.474959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d325dd7-4173-43b3-8319-f865999fbe17 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:28.475235 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d325dd7-4173-43b3-8319-f865999fbe17 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:28.475502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d325dd7-4173-43b3-8319-f865999fbe17 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:28.476197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d325dd7-4173-43b3-8319-f865999fbe17 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:28.476530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d325dd7-4173-43b3-8319-f865999fbe17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:28.477934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d325dd7-4173-43b3-8319-f865999fbe17 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:28.488266 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 531/1068] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 1 11:59:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:28.494365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc2c62-b2e6-4bc5-981b-2a18d58d0843 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:28.562187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:28.605554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc2c62-b2e6-4bc5-981b-2a18d58d0843 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:28.641875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd9567-944d-4cb2-8e02-18371f204e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:28.642907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd9567-944d-4cb2-8e02-18371f204e79 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:28.643892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd9567-944d-4cb2-8e02-18371f204e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:28.644349 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd9567-944d-4cb2-8e02-18371f204e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:28.663982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd9567-944d-4cb2-8e02-18371f204e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:28.665474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd9567-944d-4cb2-8e02-18371f204e79 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c2bd9567-944d-4cb2-8e02-18371f204e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:28.680359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:28.681584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:28.682626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:28.682626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:28.682626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:28.682626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 538/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:28.687317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d325dd7-4173-43b3-8319-f865999fbe17 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:28.738376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:28.792963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d325dd7-4173-43b3-8319-f865999fbe17 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:28.829347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e2040-4f70-4734-b306-47eac65652bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:28.829880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e2040-4f70-4734-b306-47eac65652bb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:28.830162 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e2040-4f70-4734-b306-47eac65652bb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:28.830441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e2040-4f70-4734-b306-47eac65652bb None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:28.831631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e2040-4f70-4734-b306-47eac65652bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:28.831931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e2040-4f70-4734-b306-47eac65652bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:28.833368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e2040-4f70-4734-b306-47eac65652bb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:28.845892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 532/1070] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:28.853355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd9567-944d-4cb2-8e02-18371f204e79 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:28.959682 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd9567-944d-4cb2-8e02-18371f204e79 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:28.974146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:28.995863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7f6a8-a013-4844-8f60-b7f85a05cf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:28.996517 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7f6a8-a013-4844-8f60-b7f85a05cf19 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:28.996795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7f6a8-a013-4844-8f60-b7f85a05cf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:28.997064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7f6a8-a013-4844-8f60-b7f85a05cf19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:29.005104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7f6a8-a013-4844-8f60-b7f85a05cf19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:29.006539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7f6a8-a013-4844-8f60-b7f85a05cf19 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-baa7f6a8-a013-4844-8f60-b7f85a05cf19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:59:29.018522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:29.019716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:29.020716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 539/1071] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 1 11:59:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:29.025394 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e2040-4f70-4734-b306-47eac65652bb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:29.127151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e2040-4f70-4734-b306-47eac65652bb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:29.137318 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:29.163109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca303368-eabd-4e60-bc61-b00327a25029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:29.163716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca303368-eabd-4e60-bc61-b00327a25029 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:29.163990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca303368-eabd-4e60-bc61-b00327a25029 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:29.164290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca303368-eabd-4e60-bc61-b00327a25029 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:29.165021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca303368-eabd-4e60-bc61-b00327a25029 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:29.165325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca303368-eabd-4e60-bc61-b00327a25029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:29.166747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca303368-eabd-4e60-bc61-b00327a25029 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:29.186146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 533/1072] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 1 11:59:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:29.191954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7f6a8-a013-4844-8f60-b7f85a05cf19 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:29.298797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7f6a8-a013-4844-8f60-b7f85a05cf19 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:29.334958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccfba7-0d17-41ac-85e5-73d4436d0a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:29.335586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccfba7-0d17-41ac-85e5-73d4436d0a52 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:29.335857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccfba7-0d17-41ac-85e5-73d4436d0a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:29.336125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccfba7-0d17-41ac-85e5-73d4436d0a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:29.347615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccfba7-0d17-41ac-85e5-73d4436d0a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:29.349143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccfba7-0d17-41ac-85e5-73d4436d0a52 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c9ccfba7-0d17-41ac-85e5-73d4436d0a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:29.363412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:29.364462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:29.365422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:29.365422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:29.365422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:29.365422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 540/1073] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:29.370406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca303368-eabd-4e60-bc61-b00327a25029 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:29.474873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca303368-eabd-4e60-bc61-b00327a25029 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:29.512487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277248e-a148-417f-9b2d-699e746965a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:29.513102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277248e-a148-417f-9b2d-699e746965a2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:29.513371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277248e-a148-417f-9b2d-699e746965a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:29.513639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277248e-a148-417f-9b2d-699e746965a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:29.514288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277248e-a148-417f-9b2d-699e746965a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:29.514592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277248e-a148-417f-9b2d-699e746965a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:29.516093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277248e-a148-417f-9b2d-699e746965a2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:29.528951 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 534/1074] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:29.535925 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccfba7-0d17-41ac-85e5-73d4436d0a52 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:29.565612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:29.651268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccfba7-0d17-41ac-85e5-73d4436d0a52 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:29.686961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af48d3-d0ef-44bb-85f9-de7865b5e37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:29.687607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af48d3-d0ef-44bb-85f9-de7865b5e37a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:29.687882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af48d3-d0ef-44bb-85f9-de7865b5e37a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:29.688147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af48d3-d0ef-44bb-85f9-de7865b5e37a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:29.695817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af48d3-d0ef-44bb-85f9-de7865b5e37a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:29.697295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af48d3-d0ef-44bb-85f9-de7865b5e37a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-64af48d3-d0ef-44bb-85f9-de7865b5e37a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:59:29.709525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:29.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:29.711905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:59:29.711905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:59:29.711905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:59:29.711905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:59:29.711905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:59:29.711905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:59:29.711905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:29.711905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:29.715500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 541/1075] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:29.716500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277248e-a148-417f-9b2d-699e746965a2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:29.747117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:29.831429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277248e-a148-417f-9b2d-699e746965a2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:29.866529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288e37e-be18-4b98-8c16-1998eb40b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:29.867148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e37e-be18-4b98-8c16-1998eb40b876 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:29.867512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e37e-be18-4b98-8c16-1998eb40b876 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:29.867708 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e37e-be18-4b98-8c16-1998eb40b876 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:29.868638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288e37e-be18-4b98-8c16-1998eb40b876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:29.868767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288e37e-be18-4b98-8c16-1998eb40b876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:29.870331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288e37e-be18-4b98-8c16-1998eb40b876 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:29.883245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 535/1076] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:29.889768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af48d3-d0ef-44bb-85f9-de7865b5e37a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:29.979038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:29.994915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af48d3-d0ef-44bb-85f9-de7865b5e37a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:30.032689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66880634-914b-425e-9d6f-e6dec54662d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:30.033272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66880634-914b-425e-9d6f-e6dec54662d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:30.033537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66880634-914b-425e-9d6f-e6dec54662d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:30.033955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66880634-914b-425e-9d6f-e6dec54662d0 None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/7790d6ec0e524ee6a31fd06fda9c4ac7/roles/66ad504049f14c468b41216dbc3285a4` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:30.036148 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66880634-914b-425e-9d6f-e6dec54662d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=7790d6ec0e524ee6a31fd06fda9c4ac7, role_id=66ad504049f14c468b41216dbc3285a4)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:30.037621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66880634-914b-425e-9d6f-e6dec54662d0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:30.100337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 542/1077] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:59:29 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/7790d6ec0e524ee6a31fd06fda9c4ac7/roles/66ad504049f14c468b41216dbc3285a4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:59:30.115920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f0b20-be8d-429e-a0ca-1b7119f8fb39 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:30.116203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f0b20-be8d-429e-a0ca-1b7119f8fb39 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:30.116509 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f0b20-be8d-429e-a0ca-1b7119f8fb39 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:30.117960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 536/1078] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:30.124083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5a33c-c812-4740-afbd-2886277be5b9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:30.124409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5a33c-c812-4740-afbd-2886277be5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:30.124763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5a33c-c812-4740-afbd-2886277be5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:30.145683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-61b5a33c-c812-4740-afbd-2886277be5b9 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:30.146891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-61b5a33c-c812-4740-afbd-2886277be5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:30.224099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 543/1079] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:30.495189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f0b20-be8d-429e-a0ca-1b7119f8fb39 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:30.588496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:30.604484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f0b20-be8d-429e-a0ca-1b7119f8fb39 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:30.639527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bb228-84fd-4ad7-9952-9f1e3912060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:30.640157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb228-84fd-4ad7-9952-9f1e3912060b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:30.640460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb228-84fd-4ad7-9952-9f1e3912060b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:30.640731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bb228-84fd-4ad7-9952-9f1e3912060b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:30.652421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bb228-84fd-4ad7-9952-9f1e3912060b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e59bb228-84fd-4ad7-9952-9f1e3912060b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:59:30.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:30.658395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:30.659453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 537/1080] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:30.664576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5a33c-c812-4740-afbd-2886277be5b9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:30.746867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:30.771067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5a33c-c812-4740-afbd-2886277be5b9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:30.808419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99643657-c371-4e32-b124-e91115e42d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:30.809026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99643657-c371-4e32-b124-e91115e42d19 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:30.809304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99643657-c371-4e32-b124-e91115e42d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:30.809565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99643657-c371-4e32-b124-e91115e42d19 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:30.810309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99643657-c371-4e32-b124-e91115e42d19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:30.810607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99643657-c371-4e32-b124-e91115e42d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:30.811967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99643657-c371-4e32-b124-e91115e42d19 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:30.828943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 544/1081] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:59:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:30.830254 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bb228-84fd-4ad7-9952-9f1e3912060b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:30.935712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bb228-84fd-4ad7-9952-9f1e3912060b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:30.971940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7759e-97cb-46d3-a1b5-ce00db5f4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:30.972616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7759e-97cb-46d3-a1b5-ce00db5f4b05 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:30.972893 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7759e-97cb-46d3-a1b5-ce00db5f4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:30.973163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7759e-97cb-46d3-a1b5-ce00db5f4b05 None admin] PATH_INFO: `/v3/users/4c9d442bf7724a3dbe6db83a044613a6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:30.974320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7759e-97cb-46d3-a1b5-ce00db5f4b05 None admin] RBAC: Authorizing `identity:get_user(user_id=4c9d442bf7724a3dbe6db83a044613a6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:30.975752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7759e-97cb-46d3-a1b5-ce00db5f4b05 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:30.977402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 538/1082] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:30 2022] GET /identity/v3/users/4c9d442bf7724a3dbe6db83a044613a6 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:30.983296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99643657-c371-4e32-b124-e91115e42d19 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:31.100580 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99643657-c371-4e32-b124-e91115e42d19 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:31.137662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fe8b6-fa37-4ac9-a9f9-f35383c28a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:31.138311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe8b6-fa37-4ac9-a9f9-f35383c28a35 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:31.138596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe8b6-fa37-4ac9-a9f9-f35383c28a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:31.138870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe8b6-fa37-4ac9-a9f9-f35383c28a35 None admin] PATH_INFO: `/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:31.140028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fe8b6-fa37-4ac9-a9f9-f35383c28a35 None admin] RBAC: Authorizing `identity:get_project(project_id=0d79408ea3fb4fcdacfe59ef7919256c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:31.141514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fe8b6-fa37-4ac9-a9f9-f35383c28a35 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:31.143935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 545/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:59:30 2022] GET /identity/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:31.150113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7759e-97cb-46d3-a1b5-ce00db5f4b05 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:31.167593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:31.272667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7759e-97cb-46d3-a1b5-ce00db5f4b05 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:31.317099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d89ad-bfad-4174-88f8-6981148c4142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:31.317790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d89ad-bfad-4174-88f8-6981148c4142 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:31.318069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d89ad-bfad-4174-88f8-6981148c4142 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:31.318346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d89ad-bfad-4174-88f8-6981148c4142 None admin] PATH_INFO: `/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c/users/4c9d442bf7724a3dbe6db83a044613a6/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:31.320499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d89ad-bfad-4174-88f8-6981148c4142 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d79408ea3fb4fcdacfe59ef7919256c, user_id=4c9d442bf7724a3dbe6db83a044613a6, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:31.321946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d89ad-bfad-4174-88f8-6981148c4142 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:31.380295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 539/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:59:31 2022] PUT /identity/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c/users/4c9d442bf7724a3dbe6db83a044613a6/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:59:32.026608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49286436-bebe-47e7-a8cb-2f8a3e939abe None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:32.027152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49286436-bebe-47e7-a8cb-2f8a3e939abe None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:32.027152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49286436-bebe-47e7-a8cb-2f8a3e939abe None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:32.028454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 546/1085] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:32.034248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237310-ccf6-4b8c-a320-39d1d0ddd4b3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:32.034689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237310-ccf6-4b8c-a320-39d1d0ddd4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:32.034966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237310-ccf6-4b8c-a320-39d1d0ddd4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:32.059212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3c237310-ccf6-4b8c-a320-39d1d0ddd4b3 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:32.060599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c237310-ccf6-4b8c-a320-39d1d0ddd4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:32.126800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 540/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:32.394426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49286436-bebe-47e7-a8cb-2f8a3e939abe None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:32.404735 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:32.498458 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49286436-bebe-47e7-a8cb-2f8a3e939abe None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:32.531517 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f44d6-1b01-477f-8906-2dec8ef0ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:32.532142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f44d6-1b01-477f-8906-2dec8ef0ea67 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:32.532443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f44d6-1b01-477f-8906-2dec8ef0ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:32.532713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f44d6-1b01-477f-8906-2dec8ef0ea67 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:32.543328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f44d6-1b01-477f-8906-2dec8ef0ea67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-905f44d6-1b01-477f-8906-2dec8ef0ea67 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:59:32.548014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:32.549090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:32.550100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 547/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Sep 1 11:59:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:32.555126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c237310-ccf6-4b8c-a320-39d1d0ddd4b3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:32.558958 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:32.654406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c237310-ccf6-4b8c-a320-39d1d0ddd4b3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:32.688877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd7cea-678e-47b0-9fd6-8b3cd65d736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:32.689503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd7cea-678e-47b0-9fd6-8b3cd65d736e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:32.689792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd7cea-678e-47b0-9fd6-8b3cd65d736e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:32.690661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd7cea-678e-47b0-9fd6-8b3cd65d736e None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:32.691338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd7cea-678e-47b0-9fd6-8b3cd65d736e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:32.691645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd7cea-678e-47b0-9fd6-8b3cd65d736e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:32.693064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd7cea-678e-47b0-9fd6-8b3cd65d736e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:32.701494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 541/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 1 11:59:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:32.707931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f44d6-1b01-477f-8906-2dec8ef0ea67 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:32.774053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:32.808806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f44d6-1b01-477f-8906-2dec8ef0ea67 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:32.843508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e790484-3930-40d0-acc8-095ee7e4c0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:32.844133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790484-3930-40d0-acc8-095ee7e4c0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:32.844457 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790484-3930-40d0-acc8-095ee7e4c0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:32.844727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790484-3930-40d0-acc8-095ee7e4c0e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:32.854831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e790484-3930-40d0-acc8-095ee7e4c0e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:32.856315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e790484-3930-40d0-acc8-095ee7e4c0e4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8e790484-3930-40d0-acc8-095ee7e4c0e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:32.871049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:32.872114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:32.873028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:32.873028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:32.873028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:32.876358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 548/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:32.878693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd7cea-678e-47b0-9fd6-8b3cd65d736e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:32.944668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:32.979956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd7cea-678e-47b0-9fd6-8b3cd65d736e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:33.013766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb7cab-4acb-4008-89b3-cf8f037fb99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:33.014379 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb7cab-4acb-4008-89b3-cf8f037fb99f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:33.014659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb7cab-4acb-4008-89b3-cf8f037fb99f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:33.014932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb7cab-4acb-4008-89b3-cf8f037fb99f None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:33.015574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb7cab-4acb-4008-89b3-cf8f037fb99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:33.015905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb7cab-4acb-4008-89b3-cf8f037fb99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:33.017310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb7cab-4acb-4008-89b3-cf8f037fb99f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:33.029748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 542/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:33.035564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e790484-3930-40d0-acc8-095ee7e4c0e4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:33.133563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e790484-3930-40d0-acc8-095ee7e4c0e4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:33.149928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:33.166450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624f032-80f2-490b-9fc8-3661517d5e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:33.167077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624f032-80f2-490b-9fc8-3661517d5e2a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:33.167606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624f032-80f2-490b-9fc8-3661517d5e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:33.167876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624f032-80f2-490b-9fc8-3661517d5e2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:33.175967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624f032-80f2-490b-9fc8-3661517d5e2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:33.177436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624f032-80f2-490b-9fc8-3661517d5e2a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b624f032-80f2-490b-9fc8-3661517d5e2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 11:59:33.188895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:33.189973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:33.191454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 549/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Sep 1 11:59:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:33.196640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb7cab-4acb-4008-89b3-cf8f037fb99f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:33.301137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb7cab-4acb-4008-89b3-cf8f037fb99f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:33.308537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175ac7-629a-4403-adbe-c0e96a4d6ee4 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:33.308822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175ac7-629a-4403-adbe-c0e96a4d6ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:33.309104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175ac7-629a-4403-adbe-c0e96a4d6ee4 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:33.310455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 550/1092] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:33.315813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f7dc-2be2-4901-a971-9493f33c7561 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:33.316097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f7dc-2be2-4901-a971-9493f33c7561 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:33.316408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f7dc-2be2-4901-a971-9493f33c7561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:33.327933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:33.334359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-00e7f7dc-2be2-4901-a971-9493f33c7561 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:33.335583 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-00e7f7dc-2be2-4901-a971-9493f33c7561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:33.336544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be4fd5-e4bc-4155-9b27-7b6f1a1a1983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:33.337152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be4fd5-e4bc-4155-9b27-7b6f1a1a1983 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:33.337439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be4fd5-e4bc-4155-9b27-7b6f1a1a1983 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:33.337708 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be4fd5-e4bc-4155-9b27-7b6f1a1a1983 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:33.340847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be4fd5-e4bc-4155-9b27-7b6f1a1a1983 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:33.340847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be4fd5-e4bc-4155-9b27-7b6f1a1a1983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:33.340847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be4fd5-e4bc-4155-9b27-7b6f1a1a1983 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:33.357845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 543/1093] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Sep 1 11:59:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:33.363863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be4fd5-e4bc-4155-9b27-7b6f1a1a1983 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:33.404868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 551/1094] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:33.464168 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be4fd5-e4bc-4155-9b27-7b6f1a1a1983 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:33.497910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a943cd-9c31-4142-8eca-8284d4132dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:33.498513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a943cd-9c31-4142-8eca-8284d4132dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:33.498796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a943cd-9c31-4142-8eca-8284d4132dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:33.499072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a943cd-9c31-4142-8eca-8284d4132dc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:33.551617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:33.571357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a943cd-9c31-4142-8eca-8284d4132dc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:33.572845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a943cd-9c31-4142-8eca-8284d4132dc3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:33.672996 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 544/1095] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:59:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 11:59:33.678332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7f7dc-2be2-4901-a971-9493f33c7561 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:33.679641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a943cd-9c31-4142-8eca-8284d4132dc3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:33.770492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:33.788582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a943cd-9c31-4142-8eca-8284d4132dc3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:33.788798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7f7dc-2be2-4901-a971-9493f33c7561 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:33.799591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:33.823967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfc488-8418-46a7-97e7-5c0f04a0aef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:33.824360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6d1f-1c4a-468c-b41c-e6c50df39a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:33.824633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc488-8418-46a7-97e7-5c0f04a0aef2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:33.824913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc488-8418-46a7-97e7-5c0f04a0aef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:33.825045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6d1f-1c4a-468c-b41c-e6c50df39a26 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:33.825183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc488-8418-46a7-97e7-5c0f04a0aef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:33.825284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6d1f-1c4a-468c-b41c-e6c50df39a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:33.825528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6d1f-1c4a-468c-b41c-e6c50df39a26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:33.836187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfc488-8418-46a7-97e7-5c0f04a0aef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:33.837112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a6d1f-1c4a-468c-b41c-e6c50df39a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:59:33.837824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfc488-8418-46a7-97e7-5c0f04a0aef2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-fd6a6d1f-1c4a-468c-b41c-e6c50df39a26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:59:33.841966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:33.842920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:33.843759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 552/1096] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:59:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:33.849797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6d1f-1c4a-468c-b41c-e6c50df39a26 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a3dfc488-8418-46a7-97e7-5c0f04a0aef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 11:59:33.853953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:33.854954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 11:59:33.855841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 11:59:33.855841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 11:59:33.855841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:33.855841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 545/1097] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:33.860875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfc488-8418-46a7-97e7-5c0f04a0aef2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:33.952169 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6d1f-1c4a-468c-b41c-e6c50df39a26 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:33.967366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfc488-8418-46a7-97e7-5c0f04a0aef2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:33.987981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e0fa8-6304-4131-a503-a6c517d891a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:33.988667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e0fa8-6304-4131-a503-a6c517d891a9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:33.988941 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e0fa8-6304-4131-a503-a6c517d891a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:33.989245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e0fa8-6304-4131-a503-a6c517d891a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:33.989916 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e0fa8-6304-4131-a503-a6c517d891a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:33.990220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e0fa8-6304-4131-a503-a6c517d891a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:33.991632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e0fa8-6304-4131-a503-a6c517d891a9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:34.001077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 553/1098] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:59:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:34.002191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43481-ff6f-458b-b0a2-40b74daa81e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:34.002809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43481-ff6f-458b-b0a2-40b74daa81e9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:34.003088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43481-ff6f-458b-b0a2-40b74daa81e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:34.003361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43481-ff6f-458b-b0a2-40b74daa81e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:34.004009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c43481-ff6f-458b-b0a2-40b74daa81e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:34.004355 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c43481-ff6f-458b-b0a2-40b74daa81e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:34.005717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c43481-ff6f-458b-b0a2-40b74daa81e9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:34.007046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e0fa8-6304-4131-a503-a6c517d891a9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:34.009370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:34.019870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 546/1099] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 11:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:34.026143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43481-ff6f-458b-b0a2-40b74daa81e9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:34.041131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:34.118781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e0fa8-6304-4131-a503-a6c517d891a9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:34.137918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43481-ff6f-458b-b0a2-40b74daa81e9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:34.156935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1e296-5735-4c33-9050-0237ee3ff733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:34.157569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e296-5735-4c33-9050-0237ee3ff733 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:34.157841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e296-5735-4c33-9050-0237ee3ff733 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:34.158114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1e296-5735-4c33-9050-0237ee3ff733 None admin] PATH_INFO: `/v3/users/4c9d442bf7724a3dbe6db83a044613a6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:34.159290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1e296-5735-4c33-9050-0237ee3ff733 None admin] RBAC: Authorizing `identity:get_user(user_id=4c9d442bf7724a3dbe6db83a044613a6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:34.160736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1e296-5735-4c33-9050-0237ee3ff733 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:34.162485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 554/1100] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:34 2022] GET /identity/v3/users/4c9d442bf7724a3dbe6db83a044613a6 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:34.168578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1e296-5735-4c33-9050-0237ee3ff733 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:34.175325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e03bd3-f96f-47a1-91c7-1780acd789de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:34.175965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e03bd3-f96f-47a1-91c7-1780acd789de None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:34.176272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e03bd3-f96f-47a1-91c7-1780acd789de None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:34.176570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e03bd3-f96f-47a1-91c7-1780acd789de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:34.183596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e03bd3-f96f-47a1-91c7-1780acd789de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:34.185071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e03bd3-f96f-47a1-91c7-1780acd789de None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-38e03bd3-f96f-47a1-91c7-1780acd789de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 11:59:34.197101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:34.198659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:34.199644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 11:59:34.199644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 11:59:34.199644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 11:59:34.199644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 11:59:34.199644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 11:59:34.199644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 11:59:34.199644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 11:59:34.199644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 11:59:34.199644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 547/1101] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 11:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 11:59:34.204331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e03bd3-f96f-47a1-91c7-1780acd789de None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:34.263333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:34.279872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:34.284181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1e296-5735-4c33-9050-0237ee3ff733 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:34.312932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e03bd3-f96f-47a1-91c7-1780acd789de None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:34.321981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53404b4-3a9a-4741-9dd7-cf766054491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:34.322596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53404b4-3a9a-4741-9dd7-cf766054491c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:34.322876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53404b4-3a9a-4741-9dd7-cf766054491c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:34.323149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53404b4-3a9a-4741-9dd7-cf766054491c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:34.350669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded8016-77ea-4559-b567-f628d827dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:34.351367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded8016-77ea-4559-b567-f628d827dd4f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:34.351654 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded8016-77ea-4559-b567-f628d827dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:34.351941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded8016-77ea-4559-b567-f628d827dd4f None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:34.352792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded8016-77ea-4559-b567-f628d827dd4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:34.353027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded8016-77ea-4559-b567-f628d827dd4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:34.358433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded8016-77ea-4559-b567-f628d827dd4f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:34.367905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 548/1102] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 11:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:34.374652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded8016-77ea-4559-b567-f628d827dd4f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:34.396124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53404b4-3a9a-4741-9dd7-cf766054491c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:34.397612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53404b4-3a9a-4741-9dd7-cf766054491c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:34.485399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded8016-77ea-4559-b567-f628d827dd4f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:34.504351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:34.523424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592906fa-bcce-4136-8561-8c69ac3f148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:34.524034 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592906fa-bcce-4136-8561-8c69ac3f148a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:34.524342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592906fa-bcce-4136-8561-8c69ac3f148a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:34.524614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592906fa-bcce-4136-8561-8c69ac3f148a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:34.525339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592906fa-bcce-4136-8561-8c69ac3f148a None admin] RBAC: Adding query filter params (role.id=66ad504049f14c468b41216dbc3285a4, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=7790d6ec0e524ee6a31fd06fda9c4ac7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:34.525654 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592906fa-bcce-4136-8561-8c69ac3f148a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:34.527141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592906fa-bcce-4136-8561-8c69ac3f148a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:34.528100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:34.533110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 555/1103] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:59:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 11:59:34.536518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 549/1104] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:59:34 2022] GET /identity/v3/role_assignments?user.id=7790d6ec0e524ee6a31fd06fda9c4ac7&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=66ad504049f14c468b41216dbc3285a4 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:34.539211 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53404b4-3a9a-4741-9dd7-cf766054491c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:34.656371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53404b4-3a9a-4741-9dd7-cf766054491c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:34.696683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597c292-238b-444f-a983-8f5279d81673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:34.697330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c292-238b-444f-a983-8f5279d81673 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:34.697610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c292-238b-444f-a983-8f5279d81673 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:34.697887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c292-238b-444f-a983-8f5279d81673 None admin] PATH_INFO: `/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:34.699519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c292-238b-444f-a983-8f5279d81673 None admin] RBAC: Authorizing `identity:get_project(project_id=0d79408ea3fb4fcdacfe59ef7919256c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:34.700564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c292-238b-444f-a983-8f5279d81673 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:34.702387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 556/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:59:34 2022] GET /identity/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:34.708885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592906fa-bcce-4136-8561-8c69ac3f148a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:34.816121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592906fa-bcce-4136-8561-8c69ac3f148a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:34.851786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681b10d-92e5-4326-8233-f12d27129a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:34.852456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681b10d-92e5-4326-8233-f12d27129a85 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:34.852733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681b10d-92e5-4326-8233-f12d27129a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:34.853004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681b10d-92e5-4326-8233-f12d27129a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:34.853730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681b10d-92e5-4326-8233-f12d27129a85 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=0d79408ea3fb4fcdacfe59ef7919256c, user.id=4c9d442bf7724a3dbe6db83a044613a6) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:34.854035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681b10d-92e5-4326-8233-f12d27129a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:34.855463 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681b10d-92e5-4326-8233-f12d27129a85 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:34.861614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 550/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:59:34 2022] GET /identity/v3/role_assignments?user.id=4c9d442bf7724a3dbe6db83a044613a6&scope.project.id=0d79408ea3fb4fcdacfe59ef7919256c&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:36.778748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813f35a-11f6-454c-b08e-a0ba91ba20d2 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:36.779281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813f35a-11f6-454c-b08e-a0ba91ba20d2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:36.779281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813f35a-11f6-454c-b08e-a0ba91ba20d2 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:36.780633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 557/1107] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:36.786322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2d23-e20a-4d69-ae63-210ce66cd774 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:36.786789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2d23-e20a-4d69-ae63-210ce66cd774 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:36.786916 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2d23-e20a-4d69-ae63-210ce66cd774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:36.810644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d03d2d23-e20a-4d69-ae63-210ce66cd774 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:36.811808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d03d2d23-e20a-4d69-ae63-210ce66cd774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:36.853148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:36.878447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 551/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:37.148746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813f35a-11f6-454c-b08e-a0ba91ba20d2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:37.214629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:37.249336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813f35a-11f6-454c-b08e-a0ba91ba20d2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:37.282240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016304e-49e0-4c8d-88d1-9201d0a95116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:37.282862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016304e-49e0-4c8d-88d1-9201d0a95116 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:37.283138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016304e-49e0-4c8d-88d1-9201d0a95116 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:37.283904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016304e-49e0-4c8d-88d1-9201d0a95116 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:37.285050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016304e-49e0-4c8d-88d1-9201d0a95116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:37.286466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016304e-49e0-4c8d-88d1-9201d0a95116 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:37.288034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 558/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:37.294151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2d23-e20a-4d69-ae63-210ce66cd774 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:37.391865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2d23-e20a-4d69-ae63-210ce66cd774 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:37.427837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c031c-9a94-4935-84d4-2b0e3121426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:37.428392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c031c-9a94-4935-84d4-2b0e3121426c None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:37.428670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c031c-9a94-4935-84d4-2b0e3121426c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:37.428940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c031c-9a94-4935-84d4-2b0e3121426c None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:37.429598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c031c-9a94-4935-84d4-2b0e3121426c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:37.431019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c031c-9a94-4935-84d4-2b0e3121426c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:37.534371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 552/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:59:37 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:59:39.480579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cfbe-d8b4-49ff-93a8-11cb4ed32539 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:39.481118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cfbe-d8b4-49ff-93a8-11cb4ed32539 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:39.481118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207cfbe-d8b4-49ff-93a8-11cb4ed32539 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:39.482464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 559/1111] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:39.487581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05ae76-cd33-47b6-b636-8a2729309b15 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:39.487966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05ae76-cd33-47b6-b636-8a2729309b15 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:39.488127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05ae76-cd33-47b6-b636-8a2729309b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:39.506409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9e05ae76-cd33-47b6-b636-8a2729309b15 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:39.507597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9e05ae76-cd33-47b6-b636-8a2729309b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:39.531261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:39.574035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 553/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:39.843911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207cfbe-d8b4-49ff-93a8-11cb4ed32539 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:39.946926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207cfbe-d8b4-49ff-93a8-11cb4ed32539 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:39.979872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae08912-f2a8-428c-a2ca-5c1edd9868db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:39.980533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae08912-f2a8-428c-a2ca-5c1edd9868db None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:39.980816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae08912-f2a8-428c-a2ca-5c1edd9868db None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:39.981093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae08912-f2a8-428c-a2ca-5c1edd9868db None admin] PATH_INFO: `/v3/roles/c76ef09e05ab4b329ff0580b80c56f59` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:39.982485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae08912-f2a8-428c-a2ca-5c1edd9868db None admin] RBAC: Authorizing `identity:get_role(role_id=c76ef09e05ab4b329ff0580b80c56f59)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:39.983887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae08912-f2a8-428c-a2ca-5c1edd9868db None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:39.985284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 560/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:39 2022] GET /identity/v3/roles/c76ef09e05ab4b329ff0580b80c56f59 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:39.991577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05ae76-cd33-47b6-b636-8a2729309b15 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:40.092362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05ae76-cd33-47b6-b636-8a2729309b15 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:40.126252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fe450-a97d-479f-a307-6d9411ca84d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:40.127401 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe450-a97d-479f-a307-6d9411ca84d3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:40.127690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe450-a97d-479f-a307-6d9411ca84d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:40.127962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe450-a97d-479f-a307-6d9411ca84d3 None admin] PATH_INFO: `/v3/users/32283ba8559e4fc4bda56500f261b202` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:40.146924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fe450-a97d-479f-a307-6d9411ca84d3 None admin] RBAC: Authorizing `identity:get_user(user_id=32283ba8559e4fc4bda56500f261b202)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:40.148397 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fe450-a97d-479f-a307-6d9411ca84d3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:40.150055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 554/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:39 2022] GET /identity/v3/users/32283ba8559e4fc4bda56500f261b202 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:40.155932 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae08912-f2a8-428c-a2ca-5c1edd9868db None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:40.158789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:40.255197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae08912-f2a8-428c-a2ca-5c1edd9868db None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:40.288066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32bf3e-aa7a-4d81-b7f7-5d0e0edb97f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:40.288713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32bf3e-aa7a-4d81-b7f7-5d0e0edb97f5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:40.288991 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32bf3e-aa7a-4d81-b7f7-5d0e0edb97f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:40.289255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32bf3e-aa7a-4d81-b7f7-5d0e0edb97f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:40.361674 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32bf3e-aa7a-4d81-b7f7-5d0e0edb97f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:40.363168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32bf3e-aa7a-4d81-b7f7-5d0e0edb97f5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:40.365034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:40.462332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 561/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:59:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 11:59:40.468278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fe450-a97d-479f-a307-6d9411ca84d3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:40.487305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:40.570925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fe450-a97d-479f-a307-6d9411ca84d3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:40.603889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824300-cf14-4ab9-89cc-290b0c3e6173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:40.604532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824300-cf14-4ab9-89cc-290b0c3e6173 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:40.604815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824300-cf14-4ab9-89cc-290b0c3e6173 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:40.605088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824300-cf14-4ab9-89cc-290b0c3e6173 None admin] PATH_INFO: `/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:40.606203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53824300-cf14-4ab9-89cc-290b0c3e6173 None admin] RBAC: Authorizing `identity:get_project(project_id=0d79408ea3fb4fcdacfe59ef7919256c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:40.607622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53824300-cf14-4ab9-89cc-290b0c3e6173 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:40.609285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 555/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:59:40 2022] GET /identity/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:40.616130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32bf3e-aa7a-4d81-b7f7-5d0e0edb97f5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:40.721322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32bf3e-aa7a-4d81-b7f7-5d0e0edb97f5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:40.722847 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:40.759410 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569eb306-49ab-4de3-b8a2-67fa56e5c360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:40.760005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eb306-49ab-4de3-b8a2-67fa56e5c360 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:40.760308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eb306-49ab-4de3-b8a2-67fa56e5c360 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:40.760578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eb306-49ab-4de3-b8a2-67fa56e5c360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:40.761305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569eb306-49ab-4de3-b8a2-67fa56e5c360 None admin] RBAC: Adding query filter params (role.id=c76ef09e05ab4b329ff0580b80c56f59, scope.project.id=0d79408ea3fb4fcdacfe59ef7919256c, user.id=32283ba8559e4fc4bda56500f261b202) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:40.761611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569eb306-49ab-4de3-b8a2-67fa56e5c360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:40.763017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569eb306-49ab-4de3-b8a2-67fa56e5c360 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:40.768480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 562/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:59:40 2022] GET /identity/v3/role_assignments?user.id=32283ba8559e4fc4bda56500f261b202&scope.project.id=0d79408ea3fb4fcdacfe59ef7919256c&role.id=c76ef09e05ab4b329ff0580b80c56f59 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:42.649989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e0eb3-6f8b-4390-a06b-be3b0c043e1f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:42.650515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e0eb3-6f8b-4390-a06b-be3b0c043e1f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:42.650515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e0eb3-6f8b-4390-a06b-be3b0c043e1f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:42.651863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 556/1118] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:42.657108 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ada7d-70eb-4f70-b46b-ada4ff52555f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:42.657499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ada7d-70eb-4f70-b46b-ada4ff52555f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:42.657660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ada7d-70eb-4f70-b46b-ada4ff52555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:42.677148 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1f4ada7d-70eb-4f70-b46b-ada4ff52555f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:42.678330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1f4ada7d-70eb-4f70-b46b-ada4ff52555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:42.743159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 563/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:43.014629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e0eb3-6f8b-4390-a06b-be3b0c043e1f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:43.103524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:43.119243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e0eb3-6f8b-4390-a06b-be3b0c043e1f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:43.153694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035ef96-cf27-4591-9887-d1c5aa4431b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:43.154316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035ef96-cf27-4591-9887-d1c5aa4431b1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:43.154591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035ef96-cf27-4591-9887-d1c5aa4431b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:43.154862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035ef96-cf27-4591-9887-d1c5aa4431b1 None admin] PATH_INFO: `/v3/roles/c76ef09e05ab4b329ff0580b80c56f59` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:43.156360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035ef96-cf27-4591-9887-d1c5aa4431b1 None admin] RBAC: Authorizing `identity:get_role(role_id=c76ef09e05ab4b329ff0580b80c56f59)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:43.157606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035ef96-cf27-4591-9887-d1c5aa4431b1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:43.159963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 557/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:43 2022] GET /identity/v3/roles/c76ef09e05ab4b329ff0580b80c56f59 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:43.166867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ada7d-70eb-4f70-b46b-ada4ff52555f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:43.259804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:43.265556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ada7d-70eb-4f70-b46b-ada4ff52555f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:43.304566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f3239-6a52-4f5d-b480-10dd7a009683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:43.305229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f3239-6a52-4f5d-b480-10dd7a009683 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:43.305750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f3239-6a52-4f5d-b480-10dd7a009683 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:43.306106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f3239-6a52-4f5d-b480-10dd7a009683 None admin] PATH_INFO: `/v3/users/32283ba8559e4fc4bda56500f261b202` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:43.307804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f3239-6a52-4f5d-b480-10dd7a009683 None admin] RBAC: Authorizing `identity:get_user(user_id=32283ba8559e4fc4bda56500f261b202)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:43.309304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f3239-6a52-4f5d-b480-10dd7a009683 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:43.310948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 564/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:43 2022] GET /identity/v3/users/32283ba8559e4fc4bda56500f261b202 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:43.317113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035ef96-cf27-4591-9887-d1c5aa4431b1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:43.420774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035ef96-cf27-4591-9887-d1c5aa4431b1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:43.455554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6232b0d-9f89-4a90-97b9-c2353e76da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:43.456183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6232b0d-9f89-4a90-97b9-c2353e76da2a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:43.456496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6232b0d-9f89-4a90-97b9-c2353e76da2a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:43.456770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6232b0d-9f89-4a90-97b9-c2353e76da2a None admin] PATH_INFO: `/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:43.457901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6232b0d-9f89-4a90-97b9-c2353e76da2a None admin] RBAC: Authorizing `identity:get_project(project_id=0d79408ea3fb4fcdacfe59ef7919256c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:43.459327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6232b0d-9f89-4a90-97b9-c2353e76da2a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:43.461003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 558/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:59:43 2022] GET /identity/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:43.467002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f3239-6a52-4f5d-b480-10dd7a009683 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:43.568375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f3239-6a52-4f5d-b480-10dd7a009683 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:43.602955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dde22-5c7b-4f95-a8a9-1076e0ac85ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:43.603607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dde22-5c7b-4f95-a8a9-1076e0ac85ad None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:43.603887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dde22-5c7b-4f95-a8a9-1076e0ac85ad None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:43.604163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dde22-5c7b-4f95-a8a9-1076e0ac85ad None admin] PATH_INFO: `/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c/users/32283ba8559e4fc4bda56500f261b202/roles/c76ef09e05ab4b329ff0580b80c56f59` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:43.606321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dde22-5c7b-4f95-a8a9-1076e0ac85ad None admin] RBAC: Authorizing `identity:create_grant(project_id=0d79408ea3fb4fcdacfe59ef7919256c, user_id=32283ba8559e4fc4bda56500f261b202, role_id=c76ef09e05ab4b329ff0580b80c56f59)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:43.607736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dde22-5c7b-4f95-a8a9-1076e0ac85ad None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:43.688003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 565/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:59:43 2022] PUT /identity/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c/users/32283ba8559e4fc4bda56500f261b202/roles/c76ef09e05ab4b329ff0580b80c56f59 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 11:59:45.584166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971f1d3-207f-43cf-bf68-aa6e380b01a0 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:45.584722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971f1d3-207f-43cf-bf68-aa6e380b01a0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:45.584722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971f1d3-207f-43cf-bf68-aa6e380b01a0 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:45.586173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 559/1124] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:45.591450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573d416-f6c5-47cd-a1d0-fd0ca3374c78 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:45.591876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573d416-f6c5-47cd-a1d0-fd0ca3374c78 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:45.591996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573d416-f6c5-47cd-a1d0-fd0ca3374c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:45.609997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c573d416-f6c5-47cd-a1d0-fd0ca3374c78 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:45.611216 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c573d416-f6c5-47cd-a1d0-fd0ca3374c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:45.629123 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:45.678298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 566/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:45.946890 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971f1d3-207f-43cf-bf68-aa6e380b01a0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:45.975066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:46.059377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971f1d3-207f-43cf-bf68-aa6e380b01a0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:46.094969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3266645-7bcd-46a9-9fb0-865b2e5362e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:46.096188 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3266645-7bcd-46a9-9fb0-865b2e5362e7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:46.096500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3266645-7bcd-46a9-9fb0-865b2e5362e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:46.096777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3266645-7bcd-46a9-9fb0-865b2e5362e7 None admin] PATH_INFO: `/v3/roles/c76ef09e05ab4b329ff0580b80c56f59` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:46.098219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3266645-7bcd-46a9-9fb0-865b2e5362e7 None admin] RBAC: Authorizing `identity:get_role(role_id=c76ef09e05ab4b329ff0580b80c56f59)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:46.099583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3266645-7bcd-46a9-9fb0-865b2e5362e7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:46.100954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 560/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:45 2022] GET /identity/v3/roles/c76ef09e05ab4b329ff0580b80c56f59 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:46.107243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573d416-f6c5-47cd-a1d0-fd0ca3374c78 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:46.206540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573d416-f6c5-47cd-a1d0-fd0ca3374c78 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:46.239117 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77509a69-d94e-402d-87c5-4c93c9621a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:46.239748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509a69-d94e-402d-87c5-4c93c9621a8d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:46.240031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509a69-d94e-402d-87c5-4c93c9621a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:46.240336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509a69-d94e-402d-87c5-4c93c9621a8d None admin] PATH_INFO: `/v3/users/32283ba8559e4fc4bda56500f261b202` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:46.241460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77509a69-d94e-402d-87c5-4c93c9621a8d None admin] RBAC: Authorizing `identity:get_user(user_id=32283ba8559e4fc4bda56500f261b202)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:46.242902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77509a69-d94e-402d-87c5-4c93c9621a8d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:46.244522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 567/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:46 2022] GET /identity/v3/users/32283ba8559e4fc4bda56500f261b202 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:46.250381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3266645-7bcd-46a9-9fb0-865b2e5362e7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:46.338953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:46.348093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3266645-7bcd-46a9-9fb0-865b2e5362e7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:46.382038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e173a-2e3b-4fc2-a68c-84bc107c6128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:46.382644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e173a-2e3b-4fc2-a68c-84bc107c6128 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:46.382920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e173a-2e3b-4fc2-a68c-84bc107c6128 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:46.383188 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e173a-2e3b-4fc2-a68c-84bc107c6128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:46.448540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e173a-2e3b-4fc2-a68c-84bc107c6128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:46.449969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e173a-2e3b-4fc2-a68c-84bc107c6128 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:46.535877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:46.545729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 561/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:59:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 11:59:46.552229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77509a69-d94e-402d-87c5-4c93c9621a8d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:46.576407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:46.649501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77509a69-d94e-402d-87c5-4c93c9621a8d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:46.683434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea1782-d1c5-4d94-83c7-16fdc377625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:46.684059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea1782-d1c5-4d94-83c7-16fdc377625a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:46.684374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea1782-d1c5-4d94-83c7-16fdc377625a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:46.684647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea1782-d1c5-4d94-83c7-16fdc377625a None admin] PATH_INFO: `/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:46.685905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea1782-d1c5-4d94-83c7-16fdc377625a None admin] RBAC: Authorizing `identity:get_project(project_id=0d79408ea3fb4fcdacfe59ef7919256c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:46.687159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea1782-d1c5-4d94-83c7-16fdc377625a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:46.688806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 568/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:59:46 2022] GET /identity/v3/projects/0d79408ea3fb4fcdacfe59ef7919256c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:46.695458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e173a-2e3b-4fc2-a68c-84bc107c6128 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:46.790593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e173a-2e3b-4fc2-a68c-84bc107c6128 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:46.824567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402bc5d-a62d-4a79-8acd-dc7dc139addf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:46.825169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402bc5d-a62d-4a79-8acd-dc7dc139addf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:46.825444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402bc5d-a62d-4a79-8acd-dc7dc139addf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:46.825715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402bc5d-a62d-4a79-8acd-dc7dc139addf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:46.826435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402bc5d-a62d-4a79-8acd-dc7dc139addf None admin] RBAC: Adding query filter params (role.id=c76ef09e05ab4b329ff0580b80c56f59, scope.project.id=0d79408ea3fb4fcdacfe59ef7919256c, user.id=32283ba8559e4fc4bda56500f261b202) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:46.826742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402bc5d-a62d-4a79-8acd-dc7dc139addf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:46.828152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402bc5d-a62d-4a79-8acd-dc7dc139addf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:46.833871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 562/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:59:46 2022] GET /identity/v3/role_assignments?user.id=32283ba8559e4fc4bda56500f261b202&scope.project.id=0d79408ea3fb4fcdacfe59ef7919256c&role.id=c76ef09e05ab4b329ff0580b80c56f59 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:48.739909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13f49-1ea1-4c29-8dc5-248ada6d78c2 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:48.740465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13f49-1ea1-4c29-8dc5-248ada6d78c2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:48.740465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13f49-1ea1-4c29-8dc5-248ada6d78c2 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:48.741812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 569/1131] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:48.747065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fa076-d72e-4ff4-aadb-334b27db5b54 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:48.754208 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fa076-d72e-4ff4-aadb-334b27db5b54 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:48.754208 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fa076-d72e-4ff4-aadb-334b27db5b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:48.766191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f37fa076-d72e-4ff4-aadb-334b27db5b54 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:48.768083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f37fa076-d72e-4ff4-aadb-334b27db5b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:48.819823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:48.840820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 563/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:49.107933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13f49-1ea1-4c29-8dc5-248ada6d78c2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:49.198963 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:49.209551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13f49-1ea1-4c29-8dc5-248ada6d78c2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:49.244060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4d458-1ca2-4522-a175-41619e3e67d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:49.244700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4d458-1ca2-4522-a175-41619e3e67d6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:49.244976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4d458-1ca2-4522-a175-41619e3e67d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:49.245246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4d458-1ca2-4522-a175-41619e3e67d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:49.246336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4d458-1ca2-4522-a175-41619e3e67d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:49.247748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4d458-1ca2-4522-a175-41619e3e67d6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:49.249346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 570/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:49.255667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fa076-d72e-4ff4-aadb-334b27db5b54 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:49.356834 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fa076-d72e-4ff4-aadb-334b27db5b54 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:49.395118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bdcfd-deeb-4e89-b910-8957fb06aa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:49.395737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bdcfd-deeb-4e89-b910-8957fb06aa2a None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:49.396014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bdcfd-deeb-4e89-b910-8957fb06aa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:49.396309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bdcfd-deeb-4e89-b910-8957fb06aa2a None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:49.396981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bdcfd-deeb-4e89-b910-8957fb06aa2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:49.398435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bdcfd-deeb-4e89-b910-8957fb06aa2a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:49.489280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 564/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 11:59:49 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:59:51.442542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381cdb-30ac-4aac-ad77-fcbcea7ea65b None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:51.443095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381cdb-30ac-4aac-ad77-fcbcea7ea65b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:51.443095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03381cdb-30ac-4aac-ad77-fcbcea7ea65b None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:51.444465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 571/1135] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:51.449617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804d2aa-2b66-46ed-9433-a6f50b3c16e8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:51.450040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804d2aa-2b66-46ed-9433-a6f50b3c16e8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:51.450174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804d2aa-2b66-46ed-9433-a6f50b3c16e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:51.467935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7804d2aa-2b66-46ed-9433-a6f50b3c16e8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:51.469152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7804d2aa-2b66-46ed-9433-a6f50b3c16e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:51.497849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:51.537674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 565/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:51.815563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03381cdb-30ac-4aac-ad77-fcbcea7ea65b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:51.919131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03381cdb-30ac-4aac-ad77-fcbcea7ea65b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:51.954763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b7e77-740d-4d88-8d38-3b8d35377cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:51.955397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b7e77-740d-4d88-8d38-3b8d35377cff None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:51.955680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b7e77-740d-4d88-8d38-3b8d35377cff None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:51.955955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b7e77-740d-4d88-8d38-3b8d35377cff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:51.957100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b7e77-740d-4d88-8d38-3b8d35377cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:51.958571 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b7e77-740d-4d88-8d38-3b8d35377cff None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:51.960231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 572/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 11:59:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:51.966054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804d2aa-2b66-46ed-9433-a6f50b3c16e8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:52.072980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804d2aa-2b66-46ed-9433-a6f50b3c16e8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:52.107892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154af87-88c1-43e8-8b7c-49e7d51158af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:52.108527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154af87-88c1-43e8-8b7c-49e7d51158af None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:52.113762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154af87-88c1-43e8-8b7c-49e7d51158af None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:52.113762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154af87-88c1-43e8-8b7c-49e7d51158af None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:52.113762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154af87-88c1-43e8-8b7c-49e7d51158af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:52.113762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154af87-88c1-43e8-8b7c-49e7d51158af None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:52.196173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 566/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 11:59:51 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 11:59:54.152299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead2702-49dc-482c-bf28-49862cc0285e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:54.152828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead2702-49dc-482c-bf28-49862cc0285e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:54.152828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead2702-49dc-482c-bf28-49862cc0285e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:54.154164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 573/1139] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:54.159445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa005b52-8b48-480b-ad2b-f58262572061 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:54.159876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa005b52-8b48-480b-ad2b-f58262572061 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:54.159979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa005b52-8b48-480b-ad2b-f58262572061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:54.178295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fa005b52-8b48-480b-ad2b-f58262572061 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:54.179506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fa005b52-8b48-480b-ad2b-f58262572061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:54.196116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:54.244839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 567/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 11:59:54.509198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead2702-49dc-482c-bf28-49862cc0285e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:54.535979 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:54.607308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead2702-49dc-482c-bf28-49862cc0285e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:54.640105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a27766-a12e-4ccb-8d9e-6ab221417248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:54.640765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a27766-a12e-4ccb-8d9e-6ab221417248 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:54.641047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a27766-a12e-4ccb-8d9e-6ab221417248 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:54.641320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a27766-a12e-4ccb-8d9e-6ab221417248 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:54.651862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a27766-a12e-4ccb-8d9e-6ab221417248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a0a27766-a12e-4ccb-8d9e-6ab221417248 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:59:54.656717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:54.658572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:54.659552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 574/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:54.664360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa005b52-8b48-480b-ad2b-f58262572061 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:54.763756 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa005b52-8b48-480b-ad2b-f58262572061 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:54.799017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920076e1-1290-4f21-8dd3-0f523843a7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:54.799638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920076e1-1290-4f21-8dd3-0f523843a7bb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:54.799917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920076e1-1290-4f21-8dd3-0f523843a7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:54.800192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920076e1-1290-4f21-8dd3-0f523843a7bb None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:54.800894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920076e1-1290-4f21-8dd3-0f523843a7bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:54.801201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920076e1-1290-4f21-8dd3-0f523843a7bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:54.802572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920076e1-1290-4f21-8dd3-0f523843a7bb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:54.811228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 568/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:54.817435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a27766-a12e-4ccb-8d9e-6ab221417248 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:54.902449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:54.918018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a27766-a12e-4ccb-8d9e-6ab221417248 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:54.951888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008748ae-19c9-4e91-8327-35783d929bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:54.952538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008748ae-19c9-4e91-8327-35783d929bac None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:54.952819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008748ae-19c9-4e91-8327-35783d929bac None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:54.953088 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008748ae-19c9-4e91-8327-35783d929bac None admin] PATH_INFO: `/v3/users/35203baf9477455a8492a27b74d57c05` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:54.967389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008748ae-19c9-4e91-8327-35783d929bac None admin] RBAC: Authorizing `identity:get_user(user_id=35203baf9477455a8492a27b74d57c05)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:54.968859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008748ae-19c9-4e91-8327-35783d929bac None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:54.971117 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 575/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:54 2022] GET /identity/v3/users/35203baf9477455a8492a27b74d57c05 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:54.977117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920076e1-1290-4f21-8dd3-0f523843a7bb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:54.993357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:55.076984 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920076e1-1290-4f21-8dd3-0f523843a7bb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:55.115548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9bb3d-b9fe-4ff3-a6f6-a73d42151c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:55.116161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9bb3d-b9fe-4ff3-a6f6-a73d42151c6d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:55.116470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9bb3d-b9fe-4ff3-a6f6-a73d42151c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:55.116746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9bb3d-b9fe-4ff3-a6f6-a73d42151c6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:55.185546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9bb3d-b9fe-4ff3-a6f6-a73d42151c6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:55.186992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9bb3d-b9fe-4ff3-a6f6-a73d42151c6d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:55.201703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:55.284543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 569/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 11:59:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 11:59:55.290351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008748ae-19c9-4e91-8327-35783d929bac None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:55.390078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008748ae-19c9-4e91-8327-35783d929bac None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:55.425500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d010a-93c1-4d0c-8575-c57680c560f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:55.426131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d010a-93c1-4d0c-8575-c57680c560f4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:55.426406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d010a-93c1-4d0c-8575-c57680c560f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:55.426680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d010a-93c1-4d0c-8575-c57680c560f4 None admin] PATH_INFO: `/v3/projects/2209bc18b3ca4d0b9c8c2530b4fb602e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:55.427789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d010a-93c1-4d0c-8575-c57680c560f4 None admin] RBAC: Authorizing `identity:get_project(project_id=2209bc18b3ca4d0b9c8c2530b4fb602e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:55.429356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d010a-93c1-4d0c-8575-c57680c560f4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:55.430992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 576/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:59:55 2022] GET /identity/v3/projects/2209bc18b3ca4d0b9c8c2530b4fb602e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:55.437140 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9bb3d-b9fe-4ff3-a6f6-a73d42151c6d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:55.536720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9bb3d-b9fe-4ff3-a6f6-a73d42151c6d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:55.551357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:55.578904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424c08f-057a-4274-888e-7a17cd2dd0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:55.579929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c08f-057a-4274-888e-7a17cd2dd0de None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:55.580461 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c08f-057a-4274-888e-7a17cd2dd0de None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:55.580777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c08f-057a-4274-888e-7a17cd2dd0de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:55.582148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424c08f-057a-4274-888e-7a17cd2dd0de None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=2209bc18b3ca4d0b9c8c2530b4fb602e, user.id=35203baf9477455a8492a27b74d57c05) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:55.582694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424c08f-057a-4274-888e-7a17cd2dd0de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:55.585497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424c08f-057a-4274-888e-7a17cd2dd0de None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:55.593671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 570/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 11:59:55 2022] GET /identity/v3/role_assignments?user.id=35203baf9477455a8492a27b74d57c05&scope.project.id=2209bc18b3ca4d0b9c8c2530b4fb602e&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:57.491411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55cd9-bb5c-42a1-a173-41b0b6e73839 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:57.492070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55cd9-bb5c-42a1-a173-41b0b6e73839 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:57.492070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55cd9-bb5c-42a1-a173-41b0b6e73839 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:57.493354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 577/1147] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 11:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 11:59:57.498582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce52ac-4611-47d1-a315-27eb404f702f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:57.499019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce52ac-4611-47d1-a315-27eb404f702f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:57.499134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce52ac-4611-47d1-a315-27eb404f702f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:57.516911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-76ce52ac-4611-47d1-a315-27eb404f702f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 11:59:57.518097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-76ce52ac-4611-47d1-a315-27eb404f702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 11:59:57.583176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 571/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 11:59:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 11:59:57.853197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55cd9-bb5c-42a1-a173-41b0b6e73839 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:57.868655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:57.953642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55cd9-bb5c-42a1-a173-41b0b6e73839 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:57.986053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af0d8e-315b-40c3-8343-513483125709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:57.986669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0d8e-315b-40c3-8343-513483125709 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:57.986944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0d8e-315b-40c3-8343-513483125709 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:57.987211 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0d8e-315b-40c3-8343-513483125709 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:57.997231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af0d8e-315b-40c3-8343-513483125709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-99af0d8e-315b-40c3-8343-513483125709 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 11:59:58.002480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 11:59:58.003667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 11:59:58.004631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 578/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 11:59:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 11:59:58.009734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce52ac-4611-47d1-a315-27eb404f702f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:58.109479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce52ac-4611-47d1-a315-27eb404f702f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:58.118693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:58.144282 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f00c9-6194-4071-87ee-778ab77f57e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:58.144890 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f00c9-6194-4071-87ee-778ab77f57e3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:58.145173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f00c9-6194-4071-87ee-778ab77f57e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:58.145448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f00c9-6194-4071-87ee-778ab77f57e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:58.146122 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f00c9-6194-4071-87ee-778ab77f57e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 11:59:58.146427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f00c9-6194-4071-87ee-778ab77f57e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:58.147794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f00c9-6194-4071-87ee-778ab77f57e3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:58.157528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 572/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 11:59:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:58.163489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af0d8e-315b-40c3-8343-513483125709 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:58.233536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:58.262091 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af0d8e-315b-40c3-8343-513483125709 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:58.296275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77e9e2-9300-4122-b0d9-95c52df31674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:58.296902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77e9e2-9300-4122-b0d9-95c52df31674 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:58.297179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77e9e2-9300-4122-b0d9-95c52df31674 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:58.297451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77e9e2-9300-4122-b0d9-95c52df31674 None admin] PATH_INFO: `/v3/users/35203baf9477455a8492a27b74d57c05` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:58.299257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77e9e2-9300-4122-b0d9-95c52df31674 None admin] RBAC: Authorizing `identity:get_user(user_id=35203baf9477455a8492a27b74d57c05)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:58.301995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77e9e2-9300-4122-b0d9-95c52df31674 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:58.304151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 579/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 11:59:58 2022] GET /identity/v3/users/35203baf9477455a8492a27b74d57c05 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 11:59:58.310175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f00c9-6194-4071-87ee-778ab77f57e3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:58.410226 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f00c9-6194-4071-87ee-778ab77f57e3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:58.445974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0c118-3d6a-4a27-b31e-f68cfce36cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:58.446716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0c118-3d6a-4a27-b31e-f68cfce36cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:58.446994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0c118-3d6a-4a27-b31e-f68cfce36cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:58.447306 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0c118-3d6a-4a27-b31e-f68cfce36cd5 None admin] PATH_INFO: `/v3/projects/2209bc18b3ca4d0b9c8c2530b4fb602e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:58.448604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0c118-3d6a-4a27-b31e-f68cfce36cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=2209bc18b3ca4d0b9c8c2530b4fb602e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:58.450133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0c118-3d6a-4a27-b31e-f68cfce36cd5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:58.451997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 573/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 11:59:58 2022] GET /identity/v3/projects/2209bc18b3ca4d0b9c8c2530b4fb602e => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 11:59:58.458856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77e9e2-9300-4122-b0d9-95c52df31674 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 11:59:58.565108 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77e9e2-9300-4122-b0d9-95c52df31674 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 11:59:58.599409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081d849-4e77-42e2-acf8-30c4376701c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 11:59:58.600068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d849-4e77-42e2-acf8-30c4376701c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 11:59:58.600387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d849-4e77-42e2-acf8-30c4376701c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 11:59:58.600665 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d849-4e77-42e2-acf8-30c4376701c7 None admin] PATH_INFO: `/v3/projects/2209bc18b3ca4d0b9c8c2530b4fb602e/users/35203baf9477455a8492a27b74d57c05/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 11:59:58.602597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081d849-4e77-42e2-acf8-30c4376701c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2209bc18b3ca4d0b9c8c2530b4fb602e, user_id=35203baf9477455a8492a27b74d57c05, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 11:59:58.604029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081d849-4e77-42e2-acf8-30c4376701c7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 11:59:58.682889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 11:59:58.687853 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 580/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 11:59:58 2022] PUT /identity/v3/projects/2209bc18b3ca4d0b9c8c2530b4fb602e/users/35203baf9477455a8492a27b74d57c05/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:00:00.564057 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814718-3398-4fc3-8b82-3b75bb748bd2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:00.564652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814718-3398-4fc3-8b82-3b75bb748bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:00.564652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814718-3398-4fc3-8b82-3b75bb748bd2 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:00.565942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 574/1154] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:00:00.571430 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601e48e-76d1-411c-922f-279225f07417 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:00.571857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601e48e-76d1-411c-922f-279225f07417 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:00.572036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601e48e-76d1-411c-922f-279225f07417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:00.590843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e601e48e-76d1-411c-922f-279225f07417 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:00:00.592031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e601e48e-76d1-411c-922f-279225f07417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:00:00.657038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 581/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:00:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:00:00.919447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814718-3398-4fc3-8b82-3b75bb748bd2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:00.961529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:01.022057 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814718-3398-4fc3-8b82-3b75bb748bd2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:01.055471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28774912-2f42-4215-9e31-cb9896f7f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:01.056081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774912-2f42-4215-9e31-cb9896f7f0cb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:01.056404 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774912-2f42-4215-9e31-cb9896f7f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:01.056697 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774912-2f42-4215-9e31-cb9896f7f0cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:01.066605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28774912-2f42-4215-9e31-cb9896f7f0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-28774912-2f42-4215-9e31-cb9896f7f0cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 12:00:01.072065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:00:01.073035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:00:01.073873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:00:01.076411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 575/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 12:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:00:01.079428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601e48e-76d1-411c-922f-279225f07417 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:01.185843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601e48e-76d1-411c-922f-279225f07417 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:01.215707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:01.221805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808f1b5-310b-451c-ae58-6846137ac912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:01.222414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808f1b5-310b-451c-ae58-6846137ac912 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:01.222692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808f1b5-310b-451c-ae58-6846137ac912 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:01.222963 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808f1b5-310b-451c-ae58-6846137ac912 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:01.223623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808f1b5-310b-451c-ae58-6846137ac912 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:00:01.223925 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808f1b5-310b-451c-ae58-6846137ac912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:01.225374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808f1b5-310b-451c-ae58-6846137ac912 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:01.238651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 582/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 12:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:00:01.245165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28774912-2f42-4215-9e31-cb9896f7f0cb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:01.340971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:01.345325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28774912-2f42-4215-9e31-cb9896f7f0cb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:01.378983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd18155-f246-417c-8dbb-4200ce95faaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:01.379606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18155-f246-417c-8dbb-4200ce95faaa None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:01.379886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18155-f246-417c-8dbb-4200ce95faaa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:01.380161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18155-f246-417c-8dbb-4200ce95faaa None admin] PATH_INFO: `/v3/users/35203baf9477455a8492a27b74d57c05` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:01.381322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd18155-f246-417c-8dbb-4200ce95faaa None admin] RBAC: Authorizing `identity:get_user(user_id=35203baf9477455a8492a27b74d57c05)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:01.382750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd18155-f246-417c-8dbb-4200ce95faaa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:01.384373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 576/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 12:00:01 2022] GET /identity/v3/users/35203baf9477455a8492a27b74d57c05 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:01.390513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808f1b5-310b-451c-ae58-6846137ac912 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:01.490605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808f1b5-310b-451c-ae58-6846137ac912 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:01.523073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620d620-21b5-4640-a99c-d0d606c55649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:01.523674 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620d620-21b5-4640-a99c-d0d606c55649 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:01.523950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620d620-21b5-4640-a99c-d0d606c55649 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:01.524247 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620d620-21b5-4640-a99c-d0d606c55649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:01.580537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:01.589524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620d620-21b5-4640-a99c-d0d606c55649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:01.590969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620d620-21b5-4640-a99c-d0d606c55649 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:01.687663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 583/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 12:00:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 12:00:01.693495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd18155-f246-417c-8dbb-4200ce95faaa None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:01.792780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd18155-f246-417c-8dbb-4200ce95faaa None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:01.825177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ff643-1ca4-406f-9e7a-af2638bf01d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:01.825799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ff643-1ca4-406f-9e7a-af2638bf01d4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:01.826080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ff643-1ca4-406f-9e7a-af2638bf01d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:01.826356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ff643-1ca4-406f-9e7a-af2638bf01d4 None admin] PATH_INFO: `/v3/projects/2209bc18b3ca4d0b9c8c2530b4fb602e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:01.827469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ff643-1ca4-406f-9e7a-af2638bf01d4 None admin] RBAC: Authorizing `identity:get_project(project_id=2209bc18b3ca4d0b9c8c2530b4fb602e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:01.829441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ff643-1ca4-406f-9e7a-af2638bf01d4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:01.831068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 577/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 12:00:01 2022] GET /identity/v3/projects/2209bc18b3ca4d0b9c8c2530b4fb602e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:01.837263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620d620-21b5-4640-a99c-d0d606c55649 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:01.924808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:01.933162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620d620-21b5-4640-a99c-d0d606c55649 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:01.967376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03b60a-914b-404f-89e8-9af9c2aa84c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:01.967975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03b60a-914b-404f-89e8-9af9c2aa84c5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:01.968278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03b60a-914b-404f-89e8-9af9c2aa84c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:01.968554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03b60a-914b-404f-89e8-9af9c2aa84c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:01.969338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03b60a-914b-404f-89e8-9af9c2aa84c5 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=2209bc18b3ca4d0b9c8c2530b4fb602e, user.id=35203baf9477455a8492a27b74d57c05) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:00:01.969651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03b60a-914b-404f-89e8-9af9c2aa84c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:01.971093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03b60a-914b-404f-89e8-9af9c2aa84c5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:01.976799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 584/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 12:00:01 2022] GET /identity/v3/role_assignments?user.id=35203baf9477455a8492a27b74d57c05&scope.project.id=2209bc18b3ca4d0b9c8c2530b4fb602e&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:03.914091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31820406-3e48-41f1-b13d-a42d166e2711 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:03.914613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31820406-3e48-41f1-b13d-a42d166e2711 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:03.914724 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31820406-3e48-41f1-b13d-a42d166e2711 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:03.916250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 578/1162] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:00:03.921676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fc7be-46c8-4a72-8eee-1a2690cf81c7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:03.922116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fc7be-46c8-4a72-8eee-1a2690cf81c7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:03.922322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fc7be-46c8-4a72-8eee-1a2690cf81c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:03.941657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9d6fc7be-46c8-4a72-8eee-1a2690cf81c7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:00:03.941987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9d6fc7be-46c8-4a72-8eee-1a2690cf81c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:00:04.010263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 585/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:00:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:00:04.286005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31820406-3e48-41f1-b13d-a42d166e2711 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:04.321498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:04.387345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31820406-3e48-41f1-b13d-a42d166e2711 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:04.420755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3462a-5f5a-47e4-822f-f72840784246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:04.421369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3462a-5f5a-47e4-822f-f72840784246 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:04.421655 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3462a-5f5a-47e4-822f-f72840784246 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:04.421931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3462a-5f5a-47e4-822f-f72840784246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:04.488186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3462a-5f5a-47e4-822f-f72840784246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:04.489669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3462a-5f5a-47e4-822f-f72840784246 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:04.521195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:04.586104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 579/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 12:00:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 12:00:04.591975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fc7be-46c8-4a72-8eee-1a2690cf81c7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:04.675175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:04.689950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fc7be-46c8-4a72-8eee-1a2690cf81c7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:04.724298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda359d7-f2ee-4984-a7da-ca4d46349fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:04.724917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda359d7-f2ee-4984-a7da-ca4d46349fba None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:04.725197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda359d7-f2ee-4984-a7da-ca4d46349fba None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:04.725470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda359d7-f2ee-4984-a7da-ca4d46349fba None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:04.731901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda359d7-f2ee-4984-a7da-ca4d46349fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:04.733362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda359d7-f2ee-4984-a7da-ca4d46349fba None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-eda359d7-f2ee-4984-a7da-ca4d46349fba None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:00:04.744611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:00:04.745806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:00:04.747029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 586/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 1 12:00:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:00:04.751780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3462a-5f5a-47e4-822f-f72840784246 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:04.849728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3462a-5f5a-47e4-822f-f72840784246 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:04.883723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb65f6c-4f77-4558-9a7c-635a4461aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:04.884371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb65f6c-4f77-4558-9a7c-635a4461aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:04.884665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb65f6c-4f77-4558-9a7c-635a4461aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:04.884921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb65f6c-4f77-4558-9a7c-635a4461aaa7 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:04.885565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb65f6c-4f77-4558-9a7c-635a4461aaa7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:00:04.885870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb65f6c-4f77-4558-9a7c-635a4461aaa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:04.887240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb65f6c-4f77-4558-9a7c-635a4461aaa7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:04.888820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:04.895887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 580/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Sep 1 12:00:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:06.805515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9928740-9a64-49b5-b19b-c1eb408c48ce None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:06.806082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9928740-9a64-49b5-b19b-c1eb408c48ce None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:06.806082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9928740-9a64-49b5-b19b-c1eb408c48ce None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:06.807370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 587/1167] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:00:06.812693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd3b86-5f41-48fd-bb7e-0e0ca2d5be32 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:06.813570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd3b86-5f41-48fd-bb7e-0e0ca2d5be32 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:06.813756 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd3b86-5f41-48fd-bb7e-0e0ca2d5be32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:06.831692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-52fd3b86-5f41-48fd-bb7e-0e0ca2d5be32 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:00:06.832913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52fd3b86-5f41-48fd-bb7e-0e0ca2d5be32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:00:06.899993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 581/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:00:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:00:07.172033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9928740-9a64-49b5-b19b-c1eb408c48ce None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:07.271393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9928740-9a64-49b5-b19b-c1eb408c48ce None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:07.306012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0f70e-76c0-4a11-9f9b-905cdd403166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:07.306611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0f70e-76c0-4a11-9f9b-905cdd403166 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:07.306887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0f70e-76c0-4a11-9f9b-905cdd403166 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:07.307153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0f70e-76c0-4a11-9f9b-905cdd403166 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:07.307812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0f70e-76c0-4a11-9f9b-905cdd403166 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:07.309194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0f70e-76c0-4a11-9f9b-905cdd403166 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:07.401666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 588/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Thu Sep 1 12:00:07 2022] POST /identity/v3/domains => generated 267 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:00:09.356137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660a7ac-74dc-478c-8dd5-a004a390bfa9 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:09.356721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660a7ac-74dc-478c-8dd5-a004a390bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:09.356721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660a7ac-74dc-478c-8dd5-a004a390bfa9 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:09.358023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 582/1170] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:00:09.363947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130290ea-a468-45fa-9b68-4abeb72c5afe None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:09.364422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130290ea-a468-45fa-9b68-4abeb72c5afe None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:09.364530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130290ea-a468-45fa-9b68-4abeb72c5afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:09.377956 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:09.383618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-130290ea-a468-45fa-9b68-4abeb72c5afe None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:00:09.384842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-130290ea-a468-45fa-9b68-4abeb72c5afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:00:09.462288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 589/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:00:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:00:09.732471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660a7ac-74dc-478c-8dd5-a004a390bfa9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:09.841062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660a7ac-74dc-478c-8dd5-a004a390bfa9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:09.869838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:09.878620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17d66-4c15-4c56-8aaf-0ac813447be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:09.882690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17d66-4c15-4c56-8aaf-0ac813447be2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:09.882690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17d66-4c15-4c56-8aaf-0ac813447be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:09.882690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17d66-4c15-4c56-8aaf-0ac813447be2 None admin] PATH_INFO: `/v3/domains/24627a660ba246baad3aef4f3c61f40b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:09.891146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17d66-4c15-4c56-8aaf-0ac813447be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=24627a660ba246baad3aef4f3c61f40b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:09.892631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17d66-4c15-4c56-8aaf-0ac813447be2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:09.894532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 583/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Sep 1 12:00:09 2022] GET /identity/v3/domains/24627a660ba246baad3aef4f3c61f40b => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:09.900350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130290ea-a468-45fa-9b68-4abeb72c5afe None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:09.996746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130290ea-a468-45fa-9b68-4abeb72c5afe None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:10.030071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acdda6-93b9-49c4-8257-13b21fc059ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:10.030673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acdda6-93b9-49c4-8257-13b21fc059ea None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:10.030952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acdda6-93b9-49c4-8257-13b21fc059ea None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:10.031780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acdda6-93b9-49c4-8257-13b21fc059ea None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:10.032464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acdda6-93b9-49c4-8257-13b21fc059ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:10.033883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acdda6-93b9-49c4-8257-13b21fc059ea None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:10.039214 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:10.133531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 590/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 12:00:09 2022] POST /identity/v3/projects => generated 361 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:00:12.052268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11e5d8-f0ec-4a53-a994-94a1d504ffae None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:12.052807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11e5d8-f0ec-4a53-a994-94a1d504ffae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:12.052807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11e5d8-f0ec-4a53-a994-94a1d504ffae None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:12.054127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 584/1174] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:00:12.059393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1a5e-deb3-4b98-8693-b8cda582113f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:12.059814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1a5e-deb3-4b98-8693-b8cda582113f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:12.059929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1a5e-deb3-4b98-8693-b8cda582113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:12.078424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-151f1a5e-deb3-4b98-8693-b8cda582113f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:00:12.079619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-151f1a5e-deb3-4b98-8693-b8cda582113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:00:12.148685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 591/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:00:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:00:12.418674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11e5d8-f0ec-4a53-a994-94a1d504ffae None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:12.521842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11e5d8-f0ec-4a53-a994-94a1d504ffae None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:12.554640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352cf19-6c4f-4184-8a36-70d230bab2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:12.555272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352cf19-6c4f-4184-8a36-70d230bab2cd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:12.555547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352cf19-6c4f-4184-8a36-70d230bab2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:12.555820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352cf19-6c4f-4184-8a36-70d230bab2cd None admin] PATH_INFO: `/v3/domains/24627a660ba246baad3aef4f3c61f40b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:12.556949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352cf19-6c4f-4184-8a36-70d230bab2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=24627a660ba246baad3aef4f3c61f40b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:12.558357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352cf19-6c4f-4184-8a36-70d230bab2cd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:12.559921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 585/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Sep 1 12:00:12 2022] GET /identity/v3/domains/24627a660ba246baad3aef4f3c61f40b => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:12.566208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f1a5e-deb3-4b98-8693-b8cda582113f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:12.666273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f1a5e-deb3-4b98-8693-b8cda582113f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:12.683530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:12.701136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23403b65-5a1e-43a6-bd12-90338a6e1d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:12.701745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403b65-5a1e-43a6-bd12-90338a6e1d19 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:12.702027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403b65-5a1e-43a6-bd12-90338a6e1d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:12.702299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23403b65-5a1e-43a6-bd12-90338a6e1d19 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:12.703576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403b65-5a1e-43a6-bd12-90338a6e1d19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:12.705134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23403b65-5a1e-43a6-bd12-90338a6e1d19 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:12.794748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 592/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 12:00:12 2022] POST /identity/v3/users => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:00:14.759775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd16796-f2a2-4f36-995f-3d49637a3472 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:14.760343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd16796-f2a2-4f36-995f-3d49637a3472 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:14.760343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd16796-f2a2-4f36-995f-3d49637a3472 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:14.761829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 586/1178] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:00:14.767752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff102d-1dec-479e-b1d6-713921bdff0f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:14.768159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff102d-1dec-479e-b1d6-713921bdff0f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:14.768336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff102d-1dec-479e-b1d6-713921bdff0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:14.786413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4fff102d-1dec-479e-b1d6-713921bdff0f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:00:14.787625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4fff102d-1dec-479e-b1d6-713921bdff0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:00:14.857037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 593/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:00:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:00:15.136098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd16796-f2a2-4f36-995f-3d49637a3472 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:15.193470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:15.238054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd16796-f2a2-4f36-995f-3d49637a3472 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:15.272755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18b320-c236-43e8-86a4-593a3d4ebf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:15.273382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18b320-c236-43e8-86a4-593a3d4ebf43 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:15.273670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18b320-c236-43e8-86a4-593a3d4ebf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:15.273947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18b320-c236-43e8-86a4-593a3d4ebf43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:15.284521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18b320-c236-43e8-86a4-593a3d4ebf43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0d18b320-c236-43e8-86a4-593a3d4ebf43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 12:00:15.289316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:00:15.290695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:00:15.291717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 587/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 12:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:00:15.297425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff102d-1dec-479e-b1d6-713921bdff0f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:15.398648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff102d-1dec-479e-b1d6-713921bdff0f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:15.400948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:15.433373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa019ec-1e7e-4795-aaf1-ae7543e607f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:15.433980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa019ec-1e7e-4795-aaf1-ae7543e607f4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:15.434258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa019ec-1e7e-4795-aaf1-ae7543e607f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:15.434533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa019ec-1e7e-4795-aaf1-ae7543e607f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:15.435353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa019ec-1e7e-4795-aaf1-ae7543e607f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:00:15.435489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa019ec-1e7e-4795-aaf1-ae7543e607f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:15.436886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa019ec-1e7e-4795-aaf1-ae7543e607f4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:15.445490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 594/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 12:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:15.451634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18b320-c236-43e8-86a4-593a3d4ebf43 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:15.553696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18b320-c236-43e8-86a4-593a3d4ebf43 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:15.570281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:15.587454 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a5111-e9c1-4771-be9d-8e5bd69eed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:15.588099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a5111-e9c1-4771-be9d-8e5bd69eed5e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:15.588428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a5111-e9c1-4771-be9d-8e5bd69eed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:15.588700 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a5111-e9c1-4771-be9d-8e5bd69eed5e None admin] PATH_INFO: `/v3/users/7ba09ba741594aef825174556769e642` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:15.602268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a5111-e9c1-4771-be9d-8e5bd69eed5e None admin] RBAC: Authorizing `identity:get_user(user_id=7ba09ba741594aef825174556769e642)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:15.603693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a5111-e9c1-4771-be9d-8e5bd69eed5e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:15.605391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 588/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 12:00:15 2022] GET /identity/v3/users/7ba09ba741594aef825174556769e642 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:15.612162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa019ec-1e7e-4795-aaf1-ae7543e607f4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:15.713460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa019ec-1e7e-4795-aaf1-ae7543e607f4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:15.747454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156d925-4e0f-4022-a988-b8d1b2051f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:15.748096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156d925-4e0f-4022-a988-b8d1b2051f33 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:15.750107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156d925-4e0f-4022-a988-b8d1b2051f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:15.750107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156d925-4e0f-4022-a988-b8d1b2051f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:15.783340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:15.820502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156d925-4e0f-4022-a988-b8d1b2051f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:15.821984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156d925-4e0f-4022-a988-b8d1b2051f33 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:15.924555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 595/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 12:00:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 12:00:15.930880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a5111-e9c1-4771-be9d-8e5bd69eed5e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:16.032807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a5111-e9c1-4771-be9d-8e5bd69eed5e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:16.067022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab7059-199a-4b82-a080-ee900af3f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:16.067739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab7059-199a-4b82-a080-ee900af3f57c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:16.068023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab7059-199a-4b82-a080-ee900af3f57c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:16.068427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab7059-199a-4b82-a080-ee900af3f57c None admin] PATH_INFO: `/v3/projects/f7eb1f18fa0849c48f3b56e1ecb73b74` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:16.069816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab7059-199a-4b82-a080-ee900af3f57c None admin] RBAC: Authorizing `identity:get_project(project_id=f7eb1f18fa0849c48f3b56e1ecb73b74)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:16.071395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab7059-199a-4b82-a080-ee900af3f57c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:16.073498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 589/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 12:00:15 2022] GET /identity/v3/projects/f7eb1f18fa0849c48f3b56e1ecb73b74 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:16.080027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156d925-4e0f-4022-a988-b8d1b2051f33 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:16.144897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:16.183057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156d925-4e0f-4022-a988-b8d1b2051f33 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:16.219527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a1841-554a-420f-ac03-43cc147bb0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:16.220263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a1841-554a-420f-ac03-43cc147bb0fc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:16.220626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a1841-554a-420f-ac03-43cc147bb0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:16.220903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a1841-554a-420f-ac03-43cc147bb0fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:16.221653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a1841-554a-420f-ac03-43cc147bb0fc None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=f7eb1f18fa0849c48f3b56e1ecb73b74, user.id=7ba09ba741594aef825174556769e642) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:00:16.221963 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a1841-554a-420f-ac03-43cc147bb0fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:16.223421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a1841-554a-420f-ac03-43cc147bb0fc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:16.229844 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 596/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 12:00:16 2022] GET /identity/v3/role_assignments?user.id=7ba09ba741594aef825174556769e642&scope.project.id=f7eb1f18fa0849c48f3b56e1ecb73b74&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:18.131766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1395e-1a44-4507-90d5-ee8efb8c0576 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:18.132374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1395e-1a44-4507-90d5-ee8efb8c0576 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:18.132374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1395e-1a44-4507-90d5-ee8efb8c0576 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:18.133747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 590/1186] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:00:18.139704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4356d-bede-4c0f-9ea8-6e38cbbf683a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:18.140296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4356d-bede-4c0f-9ea8-6e38cbbf683a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:18.140296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4356d-bede-4c0f-9ea8-6e38cbbf683a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:18.158343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7fb4356d-bede-4c0f-9ea8-6e38cbbf683a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:00:18.159525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7fb4356d-bede-4c0f-9ea8-6e38cbbf683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:00:18.225150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 597/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:00:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:00:18.493155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1395e-1a44-4507-90d5-ee8efb8c0576 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:18.540590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:18.599857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1395e-1a44-4507-90d5-ee8efb8c0576 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:18.633748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebf8a7-4831-4987-b669-02848a865d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:18.634377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebf8a7-4831-4987-b669-02848a865d99 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:18.634660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebf8a7-4831-4987-b669-02848a865d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:18.634936 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebf8a7-4831-4987-b669-02848a865d99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:18.645695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebf8a7-4831-4987-b669-02848a865d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e4ebf8a7-4831-4987-b669-02848a865d99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 12:00:18.650536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:00:18.651613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:00:18.652956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 591/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 12:00:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:00:18.657687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4356d-bede-4c0f-9ea8-6e38cbbf683a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:18.719007 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:18.759503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4356d-bede-4c0f-9ea8-6e38cbbf683a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:18.794015 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afde637-810e-443c-ad56-2c5fd2740d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:18.794611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde637-810e-443c-ad56-2c5fd2740d6b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:18.794891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde637-810e-443c-ad56-2c5fd2740d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:18.795584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde637-810e-443c-ad56-2c5fd2740d6b None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:18.795864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afde637-810e-443c-ad56-2c5fd2740d6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:00:18.796685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afde637-810e-443c-ad56-2c5fd2740d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:18.798058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afde637-810e-443c-ad56-2c5fd2740d6b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:18.806128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 598/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 12:00:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:18.812952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebf8a7-4831-4987-b669-02848a865d99 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:18.910252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebf8a7-4831-4987-b669-02848a865d99 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:18.911820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:18.946918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7740abc-4ac7-402e-a0a3-fcf80a3f073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:18.947545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7740abc-4ac7-402e-a0a3-fcf80a3f073c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:18.947830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7740abc-4ac7-402e-a0a3-fcf80a3f073c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:18.948109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7740abc-4ac7-402e-a0a3-fcf80a3f073c None admin] PATH_INFO: `/v3/users/7ba09ba741594aef825174556769e642` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:18.949277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7740abc-4ac7-402e-a0a3-fcf80a3f073c None admin] RBAC: Authorizing `identity:get_user(user_id=7ba09ba741594aef825174556769e642)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:18.950715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7740abc-4ac7-402e-a0a3-fcf80a3f073c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:18.952338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 592/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 12:00:18 2022] GET /identity/v3/users/7ba09ba741594aef825174556769e642 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:18.958256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afde637-810e-443c-ad56-2c5fd2740d6b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:19.066235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afde637-810e-443c-ad56-2c5fd2740d6b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:19.089106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:19.101059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab108e6-01ef-4ac8-ae12-5bdaf9010965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:19.101687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab108e6-01ef-4ac8-ae12-5bdaf9010965 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:19.101969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab108e6-01ef-4ac8-ae12-5bdaf9010965 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:19.102244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab108e6-01ef-4ac8-ae12-5bdaf9010965 None admin] PATH_INFO: `/v3/projects/f7eb1f18fa0849c48f3b56e1ecb73b74` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:19.103355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab108e6-01ef-4ac8-ae12-5bdaf9010965 None admin] RBAC: Authorizing `identity:get_project(project_id=f7eb1f18fa0849c48f3b56e1ecb73b74)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:19.104860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab108e6-01ef-4ac8-ae12-5bdaf9010965 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:19.106499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 599/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 12:00:18 2022] GET /identity/v3/projects/f7eb1f18fa0849c48f3b56e1ecb73b74 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:19.112548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7740abc-4ac7-402e-a0a3-fcf80a3f073c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:19.212437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7740abc-4ac7-402e-a0a3-fcf80a3f073c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:19.245718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e6eb4-a9f9-4f07-bc34-9403330a0d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:19.246374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6eb4-a9f9-4f07-bc34-9403330a0d29 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:19.246658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6eb4-a9f9-4f07-bc34-9403330a0d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:19.246935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6eb4-a9f9-4f07-bc34-9403330a0d29 None admin] PATH_INFO: `/v3/projects/f7eb1f18fa0849c48f3b56e1ecb73b74/users/7ba09ba741594aef825174556769e642/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:19.248855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e6eb4-a9f9-4f07-bc34-9403330a0d29 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7eb1f18fa0849c48f3b56e1ecb73b74, user_id=7ba09ba741594aef825174556769e642, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:19.250920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e6eb4-a9f9-4f07-bc34-9403330a0d29 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:19.320891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 593/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 12:00:19 2022] PUT /identity/v3/projects/f7eb1f18fa0849c48f3b56e1ecb73b74/users/7ba09ba741594aef825174556769e642/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:00:21.225150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c48d-1e3f-42b8-b11d-5b057dc511a4 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:21.225721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c48d-1e3f-42b8-b11d-5b057dc511a4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:21.225721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c48d-1e3f-42b8-b11d-5b057dc511a4 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:21.227030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 600/1193] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:00:21.232228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d74ed-67a8-4f4e-ab08-375e100f4ad8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:21.232656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d74ed-67a8-4f4e-ab08-375e100f4ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:21.232793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d74ed-67a8-4f4e-ab08-375e100f4ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:21.252521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f43d74ed-67a8-4f4e-ab08-375e100f4ad8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:00:21.253710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f43d74ed-67a8-4f4e-ab08-375e100f4ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:00:21.276930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:21.324850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 594/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:00:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:00:21.597693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16c48d-1e3f-42b8-b11d-5b057dc511a4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:21.701611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16c48d-1e3f-42b8-b11d-5b057dc511a4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:21.735221 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6842773-01c0-4615-b240-022da615eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:21.735864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6842773-01c0-4615-b240-022da615eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:21.736141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6842773-01c0-4615-b240-022da615eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:21.736439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6842773-01c0-4615-b240-022da615eaa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:21.746646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6842773-01c0-4615-b240-022da615eaa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c6842773-01c0-4615-b240-022da615eaa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 12:00:21.751510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:00:21.752773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:00:21.753862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 601/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 12:00:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:00:21.758860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d74ed-67a8-4f4e-ab08-375e100f4ad8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:21.861492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d74ed-67a8-4f4e-ab08-375e100f4ad8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:21.896335 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76623e-0443-4dba-bab2-5b99b9dc8508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:21.896940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76623e-0443-4dba-bab2-5b99b9dc8508 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:21.897218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76623e-0443-4dba-bab2-5b99b9dc8508 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:21.897488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76623e-0443-4dba-bab2-5b99b9dc8508 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:21.898155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76623e-0443-4dba-bab2-5b99b9dc8508 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:00:21.898456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76623e-0443-4dba-bab2-5b99b9dc8508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:21.899836 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76623e-0443-4dba-bab2-5b99b9dc8508 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:21.908793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 595/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 12:00:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:21.914968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6842773-01c0-4615-b240-022da615eaa6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:21.964666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:22.014027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6842773-01c0-4615-b240-022da615eaa6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:22.049158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87793b-e5a1-48a8-92ea-f4dc9d5e596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:22.049841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87793b-e5a1-48a8-92ea-f4dc9d5e596d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:22.050127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87793b-e5a1-48a8-92ea-f4dc9d5e596d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:22.050403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87793b-e5a1-48a8-92ea-f4dc9d5e596d None admin] PATH_INFO: `/v3/users/7ba09ba741594aef825174556769e642` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:22.051535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87793b-e5a1-48a8-92ea-f4dc9d5e596d None admin] RBAC: Authorizing `identity:get_user(user_id=7ba09ba741594aef825174556769e642)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:22.052985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87793b-e5a1-48a8-92ea-f4dc9d5e596d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:22.054581 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 602/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Sep 1 12:00:21 2022] GET /identity/v3/users/7ba09ba741594aef825174556769e642 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:22.060577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76623e-0443-4dba-bab2-5b99b9dc8508 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:22.085302 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:22.161601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76623e-0443-4dba-bab2-5b99b9dc8508 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:22.194630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3bab6-6da4-4d06-983e-dafdf51ecac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:22.195228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3bab6-6da4-4d06-983e-dafdf51ecac9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:22.195504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3bab6-6da4-4d06-983e-dafdf51ecac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:22.195769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3bab6-6da4-4d06-983e-dafdf51ecac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:22.260576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3bab6-6da4-4d06-983e-dafdf51ecac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:22.262038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3bab6-6da4-4d06-983e-dafdf51ecac9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:22.284259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:22.359701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 596/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 12:00:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 12:00:22.365677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87793b-e5a1-48a8-92ea-f4dc9d5e596d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:22.467001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87793b-e5a1-48a8-92ea-f4dc9d5e596d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:22.485558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:22.501741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9e265-3d1d-4ecb-88db-1dabb1d1e7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:22.502423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9e265-3d1d-4ecb-88db-1dabb1d1e7da None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:22.502696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9e265-3d1d-4ecb-88db-1dabb1d1e7da None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:22.502967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9e265-3d1d-4ecb-88db-1dabb1d1e7da None admin] PATH_INFO: `/v3/projects/f7eb1f18fa0849c48f3b56e1ecb73b74` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:22.504070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9e265-3d1d-4ecb-88db-1dabb1d1e7da None admin] RBAC: Authorizing `identity:get_project(project_id=f7eb1f18fa0849c48f3b56e1ecb73b74)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:22.505511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9e265-3d1d-4ecb-88db-1dabb1d1e7da None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:22.507183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 603/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Sep 1 12:00:22 2022] GET /identity/v3/projects/f7eb1f18fa0849c48f3b56e1ecb73b74 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:22.513675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3bab6-6da4-4d06-983e-dafdf51ecac9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:00:22.621777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3bab6-6da4-4d06-983e-dafdf51ecac9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:00:22.644135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:22.656059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0790cd-932d-4df9-aafe-9fdacaf9a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:00:22.656696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0790cd-932d-4df9-aafe-9fdacaf9a6ac None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:00:22.656974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0790cd-932d-4df9-aafe-9fdacaf9a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:00:22.657246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0790cd-932d-4df9-aafe-9fdacaf9a6ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:00:22.657967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0790cd-932d-4df9-aafe-9fdacaf9a6ac None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=f7eb1f18fa0849c48f3b56e1ecb73b74, user.id=7ba09ba741594aef825174556769e642) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:00:22.658272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0790cd-932d-4df9-aafe-9fdacaf9a6ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:00:22.659687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0790cd-932d-4df9-aafe-9fdacaf9a6ac None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:00:22.665756 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 597/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 12:00:22 2022] GET /identity/v3/role_assignments?user.id=7ba09ba741594aef825174556769e642&scope.project.id=f7eb1f18fa0849c48f3b56e1ecb73b74&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:00:32.519233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=7 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:00:32.690928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:43.224914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d8fd4-f60c-4029-a129-43701f896448 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:43.225649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d8fd4-f60c-4029-a129-43701f896448 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:43.225649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d8fd4-f60c-4029-a129-43701f896448 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:43.226835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 604/1201] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:01:43.232222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5b48a-e091-428f-a964-0063d167c088 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:43.232689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5b48a-e091-428f-a964-0063d167c088 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:43.232800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5b48a-e091-428f-a964-0063d167c088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:43.252676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4aa5b48a-e091-428f-a964-0063d167c088 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:01:43.253944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4aa5b48a-e091-428f-a964-0063d167c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:01:43.321530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 598/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:01:43.596274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d8fd4-f60c-4029-a129-43701f896448 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:43.699755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d8fd4-f60c-4029-a129-43701f896448 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:43.734159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ad5c4-830a-4328-82fe-a855aa873c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:43.735937 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ad5c4-830a-4328-82fe-a855aa873c8f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:43.735937 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ad5c4-830a-4328-82fe-a855aa873c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:43.735937 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ad5c4-830a-4328-82fe-a855aa873c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:43.746050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ad5c4-830a-4328-82fe-a855aa873c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:43.747576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ad5c4-830a-4328-82fe-a855aa873c8f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c81ad5c4-830a-4328-82fe-a855aa873c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:01:43.762099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:43.769770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:01:43.770976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:01:43.770976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:43.770976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:01:43.770976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 605/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:43.771286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5b48a-e091-428f-a964-0063d167c088 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:43.867178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5b48a-e091-428f-a964-0063d167c088 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:43.895068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:43.900814 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15a255-2f49-41e2-bfa8-1dc24ffba380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:43.901423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a255-2f49-41e2-bfa8-1dc24ffba380 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:43.901703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a255-2f49-41e2-bfa8-1dc24ffba380 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:43.901976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a255-2f49-41e2-bfa8-1dc24ffba380 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:43.902729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15a255-2f49-41e2-bfa8-1dc24ffba380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:43.902957 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15a255-2f49-41e2-bfa8-1dc24ffba380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:43.904323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15a255-2f49-41e2-bfa8-1dc24ffba380 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:43.916231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 599/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:43.922311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ad5c4-830a-4328-82fe-a855aa873c8f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:43.978347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:44.025278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ad5c4-830a-4328-82fe-a855aa873c8f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:44.059584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093716c8-7183-49c9-9221-25c2ba7d0f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:44.060225 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093716c8-7183-49c9-9221-25c2ba7d0f6a None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:44.060511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093716c8-7183-49c9-9221-25c2ba7d0f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:44.060785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093716c8-7183-49c9-9221-25c2ba7d0f6a None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:44.061454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093716c8-7183-49c9-9221-25c2ba7d0f6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:44.062976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093716c8-7183-49c9-9221-25c2ba7d0f6a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:44.206971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 606/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Sep 1 12:01:43 2022] POST /identity/v3/users => generated 251 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:01:46.195533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2023273-7338-4882-b811-a263b2341ddd None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:46.196117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2023273-7338-4882-b811-a263b2341ddd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:46.196117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2023273-7338-4882-b811-a263b2341ddd None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:46.197491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 600/1206] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:01:46.202992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd619cf8-426d-4b96-8b13-929b03e1f7cb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:46.205279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd619cf8-426d-4b96-8b13-929b03e1f7cb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:46.205279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd619cf8-426d-4b96-8b13-929b03e1f7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:46.222100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bd619cf8-426d-4b96-8b13-929b03e1f7cb None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:01:46.223302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bd619cf8-426d-4b96-8b13-929b03e1f7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:01:46.291859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 607/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:01:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:01:46.567640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2023273-7338-4882-b811-a263b2341ddd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:46.673983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2023273-7338-4882-b811-a263b2341ddd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:46.708464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2690f7f-da84-4da2-91ff-22b0b08ffc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:46.709093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2690f7f-da84-4da2-91ff-22b0b08ffc2c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:46.709371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2690f7f-da84-4da2-91ff-22b0b08ffc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:46.709644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2690f7f-da84-4da2-91ff-22b0b08ffc2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:46.720334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2690f7f-da84-4da2-91ff-22b0b08ffc2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d2690f7f-da84-4da2-91ff-22b0b08ffc2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 12:01:46.725077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:46.726232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:01:46.729133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 601/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 12:01:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 12:01:46.732416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd619cf8-426d-4b96-8b13-929b03e1f7cb None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:46.773568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:46.833147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd619cf8-426d-4b96-8b13-929b03e1f7cb None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:46.867061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215cbf9-4347-4273-87bb-e9b275649232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:46.867670 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215cbf9-4347-4273-87bb-e9b275649232 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:46.867948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215cbf9-4347-4273-87bb-e9b275649232 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:46.868244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215cbf9-4347-4273-87bb-e9b275649232 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:46.870926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215cbf9-4347-4273-87bb-e9b275649232 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:46.870926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215cbf9-4347-4273-87bb-e9b275649232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:46.871193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215cbf9-4347-4273-87bb-e9b275649232 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:46.880629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 608/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 12:01:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:46.887029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2690f7f-da84-4da2-91ff-22b0b08ffc2c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:46.941163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:46.991487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2690f7f-da84-4da2-91ff-22b0b08ffc2c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:47.026099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524636c-5ab0-4767-bd9f-c16c4a324dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:47.026723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524636c-5ab0-4767-bd9f-c16c4a324dba None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:47.027000 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524636c-5ab0-4767-bd9f-c16c4a324dba None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:47.027273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524636c-5ab0-4767-bd9f-c16c4a324dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:47.038187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524636c-5ab0-4767-bd9f-c16c4a324dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:47.039608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524636c-5ab0-4767-bd9f-c16c4a324dba None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0524636c-5ab0-4767-bd9f-c16c4a324dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:01:47.053729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:47.054866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:01:47.056308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:01:47.056308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:47.056308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:01:47.056308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 602/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:47.061120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215cbf9-4347-4273-87bb-e9b275649232 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:47.158477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:47.161540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215cbf9-4347-4273-87bb-e9b275649232 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:47.197229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94d17-25cf-4313-a283-f8acc08d193a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:47.201163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94d17-25cf-4313-a283-f8acc08d193a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:47.201163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94d17-25cf-4313-a283-f8acc08d193a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:47.201163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94d17-25cf-4313-a283-f8acc08d193a None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:47.201163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94d17-25cf-4313-a283-f8acc08d193a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:47.201163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94d17-25cf-4313-a283-f8acc08d193a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:47.201163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94d17-25cf-4313-a283-f8acc08d193a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:47.212643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 609/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:47.218706 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524636c-5ab0-4767-bd9f-c16c4a324dba None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:47.323672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524636c-5ab0-4767-bd9f-c16c4a324dba None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:47.325278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:47.359094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3feb8a-0294-43c2-947e-a1ddbb9eba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:47.359723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3feb8a-0294-43c2-947e-a1ddbb9eba49 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:47.360004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3feb8a-0294-43c2-947e-a1ddbb9eba49 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:47.360337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3feb8a-0294-43c2-947e-a1ddbb9eba49 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:47.367334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3feb8a-0294-43c2-947e-a1ddbb9eba49 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:47.378647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3feb8a-0294-43c2-947e-a1ddbb9eba49 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8a3feb8a-0294-43c2-947e-a1ddbb9eba49 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 12:01:47.380944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:47.382196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:01:47.383363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 603/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:47.388259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94d17-25cf-4313-a283-f8acc08d193a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:47.489960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94d17-25cf-4313-a283-f8acc08d193a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:47.523008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5609fa-eb02-4d3a-bf2e-a4466707b5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:47.523609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5609fa-eb02-4d3a-bf2e-a4466707b5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:47.523920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5609fa-eb02-4d3a-bf2e-a4466707b5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:47.524193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5609fa-eb02-4d3a-bf2e-a4466707b5c4 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:47.524942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5609fa-eb02-4d3a-bf2e-a4466707b5c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:47.525244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5609fa-eb02-4d3a-bf2e-a4466707b5c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:47.526684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5609fa-eb02-4d3a-bf2e-a4466707b5c4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:47.544099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 610/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 1 12:01:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:47.550620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3feb8a-0294-43c2-947e-a1ddbb9eba49 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:47.653389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3feb8a-0294-43c2-947e-a1ddbb9eba49 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:47.688137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c177-5124-47ce-ad61-f39648fd1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:47.689427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c177-5124-47ce-ad61-f39648fd1b2b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:47.689703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c177-5124-47ce-ad61-f39648fd1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:47.689976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c177-5124-47ce-ad61-f39648fd1b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:47.720746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:47.761329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c177-5124-47ce-ad61-f39648fd1b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:47.762668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c177-5124-47ce-ad61-f39648fd1b2b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:47.866426 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 604/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 12:01:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 12:01:47.872337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5609fa-eb02-4d3a-bf2e-a4466707b5c4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:47.891044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:47.973863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5609fa-eb02-4d3a-bf2e-a4466707b5c4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:48.010776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bc9ac-b294-4cd9-97c1-4ea174d0fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:48.011537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bc9ac-b294-4cd9-97c1-4ea174d0fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:48.011779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bc9ac-b294-4cd9-97c1-4ea174d0fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:48.012053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bc9ac-b294-4cd9-97c1-4ea174d0fbf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:48.022622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bc9ac-b294-4cd9-97c1-4ea174d0fbf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:48.024065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bc9ac-b294-4cd9-97c1-4ea174d0fbf8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-be6bc9ac-b294-4cd9-97c1-4ea174d0fbf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:01:48.039366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:48.043411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:01:48.044662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:01:48.044662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:48.044662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:01:48.044662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 611/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:48.046484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c177-5124-47ce-ad61-f39648fd1b2b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:48.114814 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:48.155093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c177-5124-47ce-ad61-f39648fd1b2b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:48.189998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9995ad-5743-487e-9422-18990fb24a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:48.190604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9995ad-5743-487e-9422-18990fb24a01 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:48.190888 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9995ad-5743-487e-9422-18990fb24a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:48.191168 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9995ad-5743-487e-9422-18990fb24a01 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:48.191816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9995ad-5743-487e-9422-18990fb24a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:48.192191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9995ad-5743-487e-9422-18990fb24a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:48.193575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9995ad-5743-487e-9422-18990fb24a01 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:48.205672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 605/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:48.211367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bc9ac-b294-4cd9-97c1-4ea174d0fbf8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:48.283749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:48.316813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bc9ac-b294-4cd9-97c1-4ea174d0fbf8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:48.350899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6575c8e-34d9-4b82-a997-ea5462a6d2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:48.351505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6575c8e-34d9-4b82-a997-ea5462a6d2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:48.351854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6575c8e-34d9-4b82-a997-ea5462a6d2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:48.352111 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6575c8e-34d9-4b82-a997-ea5462a6d2d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:48.358881 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6575c8e-34d9-4b82-a997-ea5462a6d2d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:48.360388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6575c8e-34d9-4b82-a997-ea5462a6d2d4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b6575c8e-34d9-4b82-a997-ea5462a6d2d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 12:01:48.371563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:48.372755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:48.374207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 12:01:48.374207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 12:01:48.374207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 12:01:48.374207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 12:01:48.374207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 12:01:48.374207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 12:01:48.374207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:01:48.374207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:01:48.374207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 612/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 12:01:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:48.378958 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9995ad-5743-487e-9422-18990fb24a01 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:48.488964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9995ad-5743-487e-9422-18990fb24a01 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:48.511782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:48.524527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccf4c3-d497-4de4-9e04-43980879b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:48.525172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccf4c3-d497-4de4-9e04-43980879b696 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:48.525507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccf4c3-d497-4de4-9e04-43980879b696 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:48.525795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccf4c3-d497-4de4-9e04-43980879b696 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:48.526496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccf4c3-d497-4de4-9e04-43980879b696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:48.526804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccf4c3-d497-4de4-9e04-43980879b696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:48.528259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccf4c3-d497-4de4-9e04-43980879b696 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:48.541519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 606/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 12:01:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:48.547618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6575c8e-34d9-4b82-a997-ea5462a6d2d4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:48.661025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6575c8e-34d9-4b82-a997-ea5462a6d2d4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:48.689733 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:48.695571 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307503e-05d4-4c0c-aedd-58d4135b70b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:48.696180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307503e-05d4-4c0c-aedd-58d4135b70b3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:48.696489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307503e-05d4-4c0c-aedd-58d4135b70b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:48.696765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307503e-05d4-4c0c-aedd-58d4135b70b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:48.697494 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307503e-05d4-4c0c-aedd-58d4135b70b3 None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=81919eaf832b4025a2118feb4e7fe042) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:48.697804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307503e-05d4-4c0c-aedd-58d4135b70b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:48.699243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307503e-05d4-4c0c-aedd-58d4135b70b3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:48.705414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 613/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 12:01:48 2022] GET /identity/v3/role_assignments?user.id=81919eaf832b4025a2118feb4e7fe042&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:50.613727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98642272-a622-4074-8812-6fa33ece7d36 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:50.614358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98642272-a622-4074-8812-6fa33ece7d36 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:50.614358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98642272-a622-4074-8812-6fa33ece7d36 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:50.615691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 607/1220] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:01:50.620961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e5e26-2477-4903-9d53-5a9a530ebf58 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:50.621442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e5e26-2477-4903-9d53-5a9a530ebf58 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:50.621529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e5e26-2477-4903-9d53-5a9a530ebf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:50.640319 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-db8e5e26-2477-4903-9d53-5a9a530ebf58 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:01:50.641616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-db8e5e26-2477-4903-9d53-5a9a530ebf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:01:50.710764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 614/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:01:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 12:01:50.977088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98642272-a622-4074-8812-6fa33ece7d36 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:51.078915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98642272-a622-4074-8812-6fa33ece7d36 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:51.112269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3941ef-0c41-4325-94a0-af9a99985016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:51.112889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3941ef-0c41-4325-94a0-af9a99985016 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:51.113165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3941ef-0c41-4325-94a0-af9a99985016 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:51.113435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3941ef-0c41-4325-94a0-af9a99985016 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:51.123161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3941ef-0c41-4325-94a0-af9a99985016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6b3941ef-0c41-4325-94a0-af9a99985016 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 12:01:51.127905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:51.128993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:01:51.130307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 608/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 12:01:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:51.135048 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e5e26-2477-4903-9d53-5a9a530ebf58 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:51.233529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e5e26-2477-4903-9d53-5a9a530ebf58 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:51.258265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:51.269526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a300a-0846-45de-88b0-ab5a041f9289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:51.270134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a300a-0846-45de-88b0-ab5a041f9289 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:51.270415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a300a-0846-45de-88b0-ab5a041f9289 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:51.270688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a300a-0846-45de-88b0-ab5a041f9289 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:51.271353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a300a-0846-45de-88b0-ab5a041f9289 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:51.271657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a300a-0846-45de-88b0-ab5a041f9289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:51.273128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a300a-0846-45de-88b0-ab5a041f9289 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:51.281224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 615/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 12:01:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:51.287977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3941ef-0c41-4325-94a0-af9a99985016 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:51.333882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:51.390156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3941ef-0c41-4325-94a0-af9a99985016 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:51.425828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca90c3-a24f-45a2-9039-8bb00f5ffb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:51.426470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca90c3-a24f-45a2-9039-8bb00f5ffb7e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:51.426774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca90c3-a24f-45a2-9039-8bb00f5ffb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:51.427052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca90c3-a24f-45a2-9039-8bb00f5ffb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:51.437831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca90c3-a24f-45a2-9039-8bb00f5ffb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:51.439311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca90c3-a24f-45a2-9039-8bb00f5ffb7e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-48ca90c3-a24f-45a2-9039-8bb00f5ffb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:01:51.453331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:51.455013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:01:51.456182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:01:51.456182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:51.456182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:01:51.456182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 609/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:51.461053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a300a-0846-45de-88b0-ab5a041f9289 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:51.562509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a300a-0846-45de-88b0-ab5a041f9289 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:51.598637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453eecc-b53c-49db-a66f-e183bbd74b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:51.602545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453eecc-b53c-49db-a66f-e183bbd74b86 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:51.602545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453eecc-b53c-49db-a66f-e183bbd74b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:51.602545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453eecc-b53c-49db-a66f-e183bbd74b86 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:51.602545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453eecc-b53c-49db-a66f-e183bbd74b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:51.602545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453eecc-b53c-49db-a66f-e183bbd74b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:51.603255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453eecc-b53c-49db-a66f-e183bbd74b86 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:51.616582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 616/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:51.622572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca90c3-a24f-45a2-9039-8bb00f5ffb7e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:51.725334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:51.732280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca90c3-a24f-45a2-9039-8bb00f5ffb7e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:51.767154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424283d-f52d-417f-aaa5-0964f5bcb0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:51.767855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424283d-f52d-417f-aaa5-0964f5bcb0fd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:51.768187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424283d-f52d-417f-aaa5-0964f5bcb0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:51.768496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424283d-f52d-417f-aaa5-0964f5bcb0fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:51.775651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424283d-f52d-417f-aaa5-0964f5bcb0fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:51.777199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424283d-f52d-417f-aaa5-0964f5bcb0fd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9424283d-f52d-417f-aaa5-0964f5bcb0fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 12:01:51.789786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:51.790874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:01:51.791882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 610/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:51.797084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453eecc-b53c-49db-a66f-e183bbd74b86 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:51.845849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:51.899903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453eecc-b53c-49db-a66f-e183bbd74b86 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:51.934901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc843d7-c26f-4928-99fc-cf9c24b457bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:51.935592 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc843d7-c26f-4928-99fc-cf9c24b457bb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:51.935877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc843d7-c26f-4928-99fc-cf9c24b457bb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:51.936148 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc843d7-c26f-4928-99fc-cf9c24b457bb None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:51.936945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc843d7-c26f-4928-99fc-cf9c24b457bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:51.937250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc843d7-c26f-4928-99fc-cf9c24b457bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:51.939194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc843d7-c26f-4928-99fc-cf9c24b457bb None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:51.957287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 617/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 1 12:01:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:51.962986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424283d-f52d-417f-aaa5-0964f5bcb0fd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:52.067088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424283d-f52d-417f-aaa5-0964f5bcb0fd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:52.100058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f29af9-7322-411d-98bc-7971e3c0fdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:52.100637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f29af9-7322-411d-98bc-7971e3c0fdcb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:52.100928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f29af9-7322-411d-98bc-7971e3c0fdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:52.101183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f29af9-7322-411d-98bc-7971e3c0fdcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:52.112266 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f29af9-7322-411d-98bc-7971e3c0fdcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:52.113715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f29af9-7322-411d-98bc-7971e3c0fdcb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-08f29af9-7322-411d-98bc-7971e3c0fdcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:01:52.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:52.129603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:01:52.130949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:01:52.130949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:52.130949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:01:52.130949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 611/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:52.135718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc843d7-c26f-4928-99fc-cf9c24b457bb None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:52.235082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc843d7-c26f-4928-99fc-cf9c24b457bb None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:52.238093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:52.270928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49d359-2076-496b-a784-6360a3658313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:52.271571 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d359-2076-496b-a784-6360a3658313 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:52.271852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d359-2076-496b-a784-6360a3658313 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:52.272129 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d359-2076-496b-a784-6360a3658313 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:52.272839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49d359-2076-496b-a784-6360a3658313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:52.273148 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49d359-2076-496b-a784-6360a3658313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:52.274621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49d359-2076-496b-a784-6360a3658313 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:52.286702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 618/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:52.292572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f29af9-7322-411d-98bc-7971e3c0fdcb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:52.302983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:52.393172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f29af9-7322-411d-98bc-7971e3c0fdcb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:52.426793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3425b-0fbd-4f98-8cce-9a699c91c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:52.427631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3425b-0fbd-4f98-8cce-9a699c91c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:52.428095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3425b-0fbd-4f98-8cce-9a699c91c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:52.429110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3425b-0fbd-4f98-8cce-9a699c91c3d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:52.437686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3425b-0fbd-4f98-8cce-9a699c91c3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:52.439291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3425b-0fbd-4f98-8cce-9a699c91c3d5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-08d3425b-0fbd-4f98-8cce-9a699c91c3d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 12:01:52.451158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:52.452894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:52.454747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 12:01:52.454747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 12:01:52.454747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 12:01:52.454747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 12:01:52.454747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 12:01:52.454747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 12:01:52.454747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:01:52.454747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:01:52.454747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 612/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 12:01:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:52.458919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49d359-2076-496b-a784-6360a3658313 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:52.560484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49d359-2076-496b-a784-6360a3658313 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:52.595466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287251c-8ba6-4930-be03-71878d6d7d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:52.596074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287251c-8ba6-4930-be03-71878d6d7d74 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:52.596383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287251c-8ba6-4930-be03-71878d6d7d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:52.596657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287251c-8ba6-4930-be03-71878d6d7d74 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:52.597356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287251c-8ba6-4930-be03-71878d6d7d74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:52.597658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287251c-8ba6-4930-be03-71878d6d7d74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:52.599084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287251c-8ba6-4930-be03-71878d6d7d74 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:52.612026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 619/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 12:01:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:01:52.618979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3425b-0fbd-4f98-8cce-9a699c91c3d5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:52.688152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:52.722416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3425b-0fbd-4f98-8cce-9a699c91c3d5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:52.755518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d6806-d0f0-4cbc-8636-4a79c99c2e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:52.756167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6806-d0f0-4cbc-8636-4a79c99c2e1e None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:52.756470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6806-d0f0-4cbc-8636-4a79c99c2e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:52.756742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6806-d0f0-4cbc-8636-4a79c99c2e1e None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/81919eaf832b4025a2118feb4e7fe042/roles/22cfc07169ee49d685af3262b384f78b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:52.771698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d6806-d0f0-4cbc-8636-4a79c99c2e1e None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=81919eaf832b4025a2118feb4e7fe042, role_id=22cfc07169ee49d685af3262b384f78b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:52.773151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d6806-d0f0-4cbc-8636-4a79c99c2e1e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:52.849312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 613/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 12:01:52 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/81919eaf832b4025a2118feb4e7fe042/roles/22cfc07169ee49d685af3262b384f78b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:01:54.802764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec29df6-3a5e-430d-9657-0d899e52049e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:54.803305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec29df6-3a5e-430d-9657-0d899e52049e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:54.803416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec29df6-3a5e-430d-9657-0d899e52049e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:54.804828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 620/1233] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:01:54.810519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ee08-5852-4f08-ab61-a769c8209c1f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:54.811008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ee08-5852-4f08-ab61-a769c8209c1f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:54.811094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ee08-5852-4f08-ab61-a769c8209c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:54.831501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2c79ee08-5852-4f08-ab61-a769c8209c1f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:01:54.836549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c79ee08-5852-4f08-ab61-a769c8209c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:01:54.902070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 614/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:01:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:01:55.183376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec29df6-3a5e-430d-9657-0d899e52049e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:55.209346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:55.286086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec29df6-3a5e-430d-9657-0d899e52049e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:55.324653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ea23d-922b-4554-a24d-9e7a9753f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:55.325311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ea23d-922b-4554-a24d-9e7a9753f76d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:55.325591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ea23d-922b-4554-a24d-9e7a9753f76d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:55.325863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ea23d-922b-4554-a24d-9e7a9753f76d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:55.336160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ea23d-922b-4554-a24d-9e7a9753f76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e46ea23d-922b-4554-a24d-9e7a9753f76d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 12:01:55.341059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:55.345666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:01:55.346780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 621/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Sep 1 12:01:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:55.348894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79ee08-5852-4f08-ab61-a769c8209c1f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:55.398606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:55.452124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79ee08-5852-4f08-ab61-a769c8209c1f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:55.487366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1a4d6-a349-4415-9805-656c8d1e1e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:55.487970 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a4d6-a349-4415-9805-656c8d1e1e5b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:55.488277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a4d6-a349-4415-9805-656c8d1e1e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:55.488557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a4d6-a349-4415-9805-656c8d1e1e5b None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:55.489223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1a4d6-a349-4415-9805-656c8d1e1e5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:55.489525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1a4d6-a349-4415-9805-656c8d1e1e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:55.490918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1a4d6-a349-4415-9805-656c8d1e1e5b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:55.499626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 615/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Sep 1 12:01:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:55.505772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ea23d-922b-4554-a24d-9e7a9753f76d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:55.593812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:55.610779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ea23d-922b-4554-a24d-9e7a9753f76d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:55.645356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82cd92-9140-46bb-8405-3baf1e64466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:55.645993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82cd92-9140-46bb-8405-3baf1e64466b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:55.646267 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82cd92-9140-46bb-8405-3baf1e64466b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:55.646644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82cd92-9140-46bb-8405-3baf1e64466b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:55.657626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82cd92-9140-46bb-8405-3baf1e64466b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:55.658926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82cd92-9140-46bb-8405-3baf1e64466b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-2a82cd92-9140-46bb-8405-3baf1e64466b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:01:55.674440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:55.675640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:01:55.676777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:01:55.676777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:55.676777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:01:55.676777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 622/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:55.681681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1a4d6-a349-4415-9805-656c8d1e1e5b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:55.786770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1a4d6-a349-4415-9805-656c8d1e1e5b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:55.795619 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:55.819415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e27fb4-c5e7-48e2-b934-6b5a4e20ed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:55.820119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e27fb4-c5e7-48e2-b934-6b5a4e20ed13 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:55.820324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e27fb4-c5e7-48e2-b934-6b5a4e20ed13 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:55.820597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e27fb4-c5e7-48e2-b934-6b5a4e20ed13 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:55.821233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e27fb4-c5e7-48e2-b934-6b5a4e20ed13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:55.821536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e27fb4-c5e7-48e2-b934-6b5a4e20ed13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:55.822892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e27fb4-c5e7-48e2-b934-6b5a4e20ed13 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:55.834859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 616/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:55.840827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82cd92-9140-46bb-8405-3baf1e64466b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:55.942061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82cd92-9140-46bb-8405-3baf1e64466b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:55.976260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50903ec1-f8dd-43b7-933d-2993d4f0fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:55.976891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903ec1-f8dd-43b7-933d-2993d4f0fbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:55.977169 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903ec1-f8dd-43b7-933d-2993d4f0fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:55.977447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903ec1-f8dd-43b7-933d-2993d4f0fbd5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:55.980070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:55.985074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50903ec1-f8dd-43b7-933d-2993d4f0fbd5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:55.986529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50903ec1-f8dd-43b7-933d-2993d4f0fbd5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-50903ec1-f8dd-43b7-933d-2993d4f0fbd5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 12:01:56.000299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:56.001419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:01:56.002603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 623/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:56.004648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e27fb4-c5e7-48e2-b934-6b5a4e20ed13 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:56.105708 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e27fb4-c5e7-48e2-b934-6b5a4e20ed13 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:56.140017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b008712-0428-4ea1-9a73-be38c3c77896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:56.140696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008712-0428-4ea1-9a73-be38c3c77896 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:56.140973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008712-0428-4ea1-9a73-be38c3c77896 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:56.141246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008712-0428-4ea1-9a73-be38c3c77896 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:56.142583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b008712-0428-4ea1-9a73-be38c3c77896 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:56.142887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b008712-0428-4ea1-9a73-be38c3c77896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:56.144409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b008712-0428-4ea1-9a73-be38c3c77896 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:56.162118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 617/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 1 12:01:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:56.198859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50903ec1-f8dd-43b7-933d-2993d4f0fbd5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:56.272130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50903ec1-f8dd-43b7-933d-2993d4f0fbd5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:56.305786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ee2c4-245b-48d4-ad2a-b119a746e1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:56.306447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ee2c4-245b-48d4-ad2a-b119a746e1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:56.306727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ee2c4-245b-48d4-ad2a-b119a746e1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:56.307001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ee2c4-245b-48d4-ad2a-b119a746e1a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:56.367564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:56.373977 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ee2c4-245b-48d4-ad2a-b119a746e1a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:56.375537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ee2c4-245b-48d4-ad2a-b119a746e1a5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:56.473306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 624/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 12:01:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 12:01:56.479153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b008712-0428-4ea1-9a73-be38c3c77896 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:56.507513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:56.579309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b008712-0428-4ea1-9a73-be38c3c77896 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:56.622562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8b299-23a9-4d56-b792-675a4a54d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:56.622562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8b299-23a9-4d56-b792-675a4a54d694 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:56.622562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8b299-23a9-4d56-b792-675a4a54d694 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:56.622562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8b299-23a9-4d56-b792-675a4a54d694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:56.631236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8b299-23a9-4d56-b792-675a4a54d694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:56.632721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8b299-23a9-4d56-b792-675a4a54d694 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ebb8b299-23a9-4d56-b792-675a4a54d694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:01:56.647714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:56.648905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:01:56.650007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:01:56.650007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:01:56.650007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:01:56.650007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 618/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:56.654733 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ee2c4-245b-48d4-ad2a-b119a746e1a5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:56.747635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:56.753810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ee2c4-245b-48d4-ad2a-b119a746e1a5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:56.787209 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00848a9f-cb97-4884-a092-83949964fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:56.787814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00848a9f-cb97-4884-a092-83949964fe27 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:56.788097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00848a9f-cb97-4884-a092-83949964fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:56.788401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00848a9f-cb97-4884-a092-83949964fe27 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:56.789041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00848a9f-cb97-4884-a092-83949964fe27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:56.789466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00848a9f-cb97-4884-a092-83949964fe27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:56.790797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00848a9f-cb97-4884-a092-83949964fe27 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:56.802688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 625/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:56.808377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8b299-23a9-4d56-b792-675a4a54d694 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:56.887260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:56.908228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8b299-23a9-4d56-b792-675a4a54d694 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:56.942168 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e260ab0-3b73-4b19-855c-62e5042154b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:56.942802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260ab0-3b73-4b19-855c-62e5042154b5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:56.943083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260ab0-3b73-4b19-855c-62e5042154b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:56.943418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e260ab0-3b73-4b19-855c-62e5042154b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:56.950135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e260ab0-3b73-4b19-855c-62e5042154b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:56.951612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e260ab0-3b73-4b19-855c-62e5042154b5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6e260ab0-3b73-4b19-855c-62e5042154b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 12:01:56.962798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:56.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:56.965091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 12:01:56.965091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 12:01:56.965091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 12:01:56.965091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 12:01:56.965091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 12:01:56.965091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 12:01:56.965091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:01:56.965091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:01:56.965091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 619/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 12:01:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:56.970455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00848a9f-cb97-4884-a092-83949964fe27 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:57.074162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00848a9f-cb97-4884-a092-83949964fe27 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:57.109005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eeea7d-87c0-48a8-81b5-c0f5a901e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:57.109615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeea7d-87c0-48a8-81b5-c0f5a901e18f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:57.109895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeea7d-87c0-48a8-81b5-c0f5a901e18f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:57.110750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeea7d-87c0-48a8-81b5-c0f5a901e18f None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:57.111457 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eeea7d-87c0-48a8-81b5-c0f5a901e18f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:57.111765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eeea7d-87c0-48a8-81b5-c0f5a901e18f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:57.113273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eeea7d-87c0-48a8-81b5-c0f5a901e18f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:57.125587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 626/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 12:01:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:57.132012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e260ab0-3b73-4b19-855c-62e5042154b5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:57.237139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e260ab0-3b73-4b19-855c-62e5042154b5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:57.271485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab9438-248f-47be-a424-189804a1b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:57.272089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9438-248f-47be-a424-189804a1b041 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:57.272401 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9438-248f-47be-a424-189804a1b041 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:57.272674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9438-248f-47be-a424-189804a1b041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:57.273391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab9438-248f-47be-a424-189804a1b041 None admin] RBAC: Adding query filter params (role.id=22cfc07169ee49d685af3262b384f78b, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=81919eaf832b4025a2118feb4e7fe042) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:57.273697 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab9438-248f-47be-a424-189804a1b041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:57.275110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab9438-248f-47be-a424-189804a1b041 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:57.281251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 620/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 12:01:57 2022] GET /identity/v3/role_assignments?user.id=81919eaf832b4025a2118feb4e7fe042&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=22cfc07169ee49d685af3262b384f78b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:01:59.239126 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02022b-b314-4506-8be6-d54da96cbcc9 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:59.239688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02022b-b314-4506-8be6-d54da96cbcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:59.239688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02022b-b314-4506-8be6-d54da96cbcc9 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:59.241160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 627/1247] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:01:59.246380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d504e45-47b9-4d3f-ae67-959bcd898863 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:59.246780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d504e45-47b9-4d3f-ae67-959bcd898863 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:59.246939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d504e45-47b9-4d3f-ae67-959bcd898863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:59.253898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:59.266308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2d504e45-47b9-4d3f-ae67-959bcd898863 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:01:59.268099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d504e45-47b9-4d3f-ae67-959bcd898863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:01:59.339190 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 621/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:01:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:01:59.613089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02022b-b314-4506-8be6-d54da96cbcc9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:59.631811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:59.719027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02022b-b314-4506-8be6-d54da96cbcc9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:59.753416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d040-3f6d-4741-bea4-3732df705e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:59.754129 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d040-3f6d-4741-bea4-3732df705e76 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:59.754412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d040-3f6d-4741-bea4-3732df705e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:59.754687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d040-3f6d-4741-bea4-3732df705e76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:59.764629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293d040-3f6d-4741-bea4-3732df705e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a293d040-3f6d-4741-bea4-3732df705e76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 12:01:59.769489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:01:59.770635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:01:59.771913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 628/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 12:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:01:59.776752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d504e45-47b9-4d3f-ae67-959bcd898863 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:01:59.877491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d504e45-47b9-4d3f-ae67-959bcd898863 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:01:59.906747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:01:59.912505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2ce9-47a0-4593-8364-683d01d7bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:01:59.913114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2ce9-47a0-4593-8364-683d01d7bd19 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:01:59.913395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2ce9-47a0-4593-8364-683d01d7bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:01:59.913672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2ce9-47a0-4593-8364-683d01d7bd19 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:01:59.914341 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c2ce9-47a0-4593-8364-683d01d7bd19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:01:59.914656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c2ce9-47a0-4593-8364-683d01d7bd19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:01:59.916019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c2ce9-47a0-4593-8364-683d01d7bd19 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:01:59.924693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 622/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 12:01:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:01:59.930725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d040-3f6d-4741-bea4-3732df705e76 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:00.011809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:00.035422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d040-3f6d-4741-bea4-3732df705e76 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:00.068010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405f54e-cc8a-45e9-8bbd-eccb48aa6d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:00.068656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f54e-cc8a-45e9-8bbd-eccb48aa6d21 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:00.068931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f54e-cc8a-45e9-8bbd-eccb48aa6d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:00.069196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f54e-cc8a-45e9-8bbd-eccb48aa6d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:00.078662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405f54e-cc8a-45e9-8bbd-eccb48aa6d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:00.080083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405f54e-cc8a-45e9-8bbd-eccb48aa6d21 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8405f54e-cc8a-45e9-8bbd-eccb48aa6d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:02:00.095615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:00.099633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:02:00.100586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:02:00.100586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:00.100586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:02:00.100586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 629/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:00.102739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2ce9-47a0-4593-8364-683d01d7bd19 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:00.201600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2ce9-47a0-4593-8364-683d01d7bd19 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:00.234769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afcef1-eb0f-40e9-96dd-bdd6ba806eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:00.235918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afcef1-eb0f-40e9-96dd-bdd6ba806eba None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:00.236192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afcef1-eb0f-40e9-96dd-bdd6ba806eba None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:00.236490 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afcef1-eb0f-40e9-96dd-bdd6ba806eba None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:00.237123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afcef1-eb0f-40e9-96dd-bdd6ba806eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:00.237420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afcef1-eb0f-40e9-96dd-bdd6ba806eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:00.238766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afcef1-eb0f-40e9-96dd-bdd6ba806eba None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:00.250244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 623/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:00.257851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405f54e-cc8a-45e9-8bbd-eccb48aa6d21 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:00.359920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405f54e-cc8a-45e9-8bbd-eccb48aa6d21 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:00.385968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:00.394068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df86d9-6068-4f08-93ed-e30fb1c13c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:00.394699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df86d9-6068-4f08-93ed-e30fb1c13c85 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:00.394973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df86d9-6068-4f08-93ed-e30fb1c13c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:00.395240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df86d9-6068-4f08-93ed-e30fb1c13c85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:00.402695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df86d9-6068-4f08-93ed-e30fb1c13c85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:00.404103 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df86d9-6068-4f08-93ed-e30fb1c13c85 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f4df86d9-6068-4f08-93ed-e30fb1c13c85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 12:02:00.415968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:00.417191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:02:00.418133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 630/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:02:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:00.423257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afcef1-eb0f-40e9-96dd-bdd6ba806eba None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:00.478684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:00.521910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afcef1-eb0f-40e9-96dd-bdd6ba806eba None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:00.555718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb49d6c-fb7d-4a69-888c-1c2f6b518b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:00.556351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb49d6c-fb7d-4a69-888c-1c2f6b518b3e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:00.556629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb49d6c-fb7d-4a69-888c-1c2f6b518b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:00.556900 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb49d6c-fb7d-4a69-888c-1c2f6b518b3e None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:00.557621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb49d6c-fb7d-4a69-888c-1c2f6b518b3e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:00.557922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb49d6c-fb7d-4a69-888c-1c2f6b518b3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:00.559326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb49d6c-fb7d-4a69-888c-1c2f6b518b3e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:00.577380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 624/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 1 12:02:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:00.583827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df86d9-6068-4f08-93ed-e30fb1c13c85 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:00.683765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df86d9-6068-4f08-93ed-e30fb1c13c85 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:00.718401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3d2b2-b7ce-41ca-ba13-4b88e23408f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:00.719013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3d2b2-b7ce-41ca-ba13-4b88e23408f8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:00.719293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3d2b2-b7ce-41ca-ba13-4b88e23408f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:00.719565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3d2b2-b7ce-41ca-ba13-4b88e23408f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:00.774695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:00.786900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3d2b2-b7ce-41ca-ba13-4b88e23408f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:00.788382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3d2b2-b7ce-41ca-ba13-4b88e23408f8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:00.903887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 631/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 12:02:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 12:02:00.911183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb49d6c-fb7d-4a69-888c-1c2f6b518b3e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:01.015516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb49d6c-fb7d-4a69-888c-1c2f6b518b3e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:01.032317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:01.054882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ee33c-5e58-4094-a70e-5b3836a67f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:01.055553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ee33c-5e58-4094-a70e-5b3836a67f05 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:01.055836 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ee33c-5e58-4094-a70e-5b3836a67f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:01.056107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ee33c-5e58-4094-a70e-5b3836a67f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:01.066799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ee33c-5e58-4094-a70e-5b3836a67f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ee33c-5e58-4094-a70e-5b3836a67f05 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d82ee33c-5e58-4094-a70e-5b3836a67f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:01.082976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:01.083871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:01.084952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:01.084952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:01.084952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:02:01.084952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:02:01.084952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:01.084952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:01.084952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 625/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:01.089787 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3d2b2-b7ce-41ca-ba13-4b88e23408f8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:01.178952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:01.191572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3d2b2-b7ce-41ca-ba13-4b88e23408f8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:01.225205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3e835-0e72-4f6c-bc8c-21f7062bebae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:01.225809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3e835-0e72-4f6c-bc8c-21f7062bebae None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:01.226158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3e835-0e72-4f6c-bc8c-21f7062bebae None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:01.226429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3e835-0e72-4f6c-bc8c-21f7062bebae None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:01.227076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3e835-0e72-4f6c-bc8c-21f7062bebae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:01.227380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3e835-0e72-4f6c-bc8c-21f7062bebae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:01.228774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3e835-0e72-4f6c-bc8c-21f7062bebae None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:01.240851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 632/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:01.246615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ee33c-5e58-4094-a70e-5b3836a67f05 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:01.350402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ee33c-5e58-4094-a70e-5b3836a67f05 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:01.385889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf311b8-1725-469c-8095-9179042d10dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:01.386686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf311b8-1725-469c-8095-9179042d10dd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:01.387065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf311b8-1725-469c-8095-9179042d10dd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:01.387435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf311b8-1725-469c-8095-9179042d10dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:01.395389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf311b8-1725-469c-8095-9179042d10dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:01.396930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf311b8-1725-469c-8095-9179042d10dd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-caf311b8-1725-469c-8095-9179042d10dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 12:02:01.412511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:01.413593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:01.414729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 12:02:01.414729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 12:02:01.414729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 12:02:01.414729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 12:02:01.414729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 12:02:01.414729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 12:02:01.414729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:02:01.414729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:01.414729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 626/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 12:02:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 12:02:01.417096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3e835-0e72-4f6c-bc8c-21f7062bebae None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:01.527443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3e835-0e72-4f6c-bc8c-21f7062bebae None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:01.562076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454536-9172-45b9-b4a6-4b8ee62e9699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:01.567233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454536-9172-45b9-b4a6-4b8ee62e9699 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:01.567233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454536-9172-45b9-b4a6-4b8ee62e9699 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:01.567233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454536-9172-45b9-b4a6-4b8ee62e9699 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:01.567233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f454536-9172-45b9-b4a6-4b8ee62e9699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:01.567233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f454536-9172-45b9-b4a6-4b8ee62e9699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:01.567233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f454536-9172-45b9-b4a6-4b8ee62e9699 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:01.577637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 633/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 12:02:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:01.583783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf311b8-1725-469c-8095-9179042d10dd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:01.611016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:01.688269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf311b8-1725-469c-8095-9179042d10dd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:01.722581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a341e3-d7c5-4d8f-8c11-86f5d63fbf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:01.723176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a341e3-d7c5-4d8f-8c11-86f5d63fbf71 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:01.723445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a341e3-d7c5-4d8f-8c11-86f5d63fbf71 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:01.723713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a341e3-d7c5-4d8f-8c11-86f5d63fbf71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:01.724460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a341e3-d7c5-4d8f-8c11-86f5d63fbf71 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=81919eaf832b4025a2118feb4e7fe042) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:01.724765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a341e3-d7c5-4d8f-8c11-86f5d63fbf71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:01.726174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a341e3-d7c5-4d8f-8c11-86f5d63fbf71 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:01.731494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 627/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 12:02:01 2022] GET /identity/v3/role_assignments?user.id=81919eaf832b4025a2118feb4e7fe042&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:03.662762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c52e02-edc7-4470-bc88-81740ec0a186 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:03.663353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c52e02-edc7-4470-bc88-81740ec0a186 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:03.663353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c52e02-edc7-4470-bc88-81740ec0a186 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:03.664698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 634/1261] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:02:03.669942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d338a9b-dfd8-428a-9318-b6bec1d4fd4a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:03.670398 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d338a9b-dfd8-428a-9318-b6bec1d4fd4a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:03.670503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d338a9b-dfd8-428a-9318-b6bec1d4fd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:03.689412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6d338a9b-dfd8-428a-9318-b6bec1d4fd4a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:02:03.690604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d338a9b-dfd8-428a-9318-b6bec1d4fd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:02:03.758080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 628/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:02:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:02:04.022125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c52e02-edc7-4470-bc88-81740ec0a186 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:04.033490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:04.125464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c52e02-edc7-4470-bc88-81740ec0a186 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:04.160526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8f5fc-8bff-43c2-b3a5-2057e9c34153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:04.161200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f5fc-8bff-43c2-b3a5-2057e9c34153 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:04.161480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f5fc-8bff-43c2-b3a5-2057e9c34153 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:04.161752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8f5fc-8bff-43c2-b3a5-2057e9c34153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:04.171693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8f5fc-8bff-43c2-b3a5-2057e9c34153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-72d8f5fc-8bff-43c2-b3a5-2057e9c34153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 12:02:04.177150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:04.178272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:02:04.179186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 635/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 12:02:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:04.184467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d338a9b-dfd8-428a-9318-b6bec1d4fd4a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:04.203023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:04.281285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d338a9b-dfd8-428a-9318-b6bec1d4fd4a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:04.319762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270221b-7359-43c4-9bee-d2b906673f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:04.320402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270221b-7359-43c4-9bee-d2b906673f40 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:04.320743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270221b-7359-43c4-9bee-d2b906673f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:04.321031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270221b-7359-43c4-9bee-d2b906673f40 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:04.321708 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270221b-7359-43c4-9bee-d2b906673f40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:04.322016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270221b-7359-43c4-9bee-d2b906673f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:04.323519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270221b-7359-43c4-9bee-d2b906673f40 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:04.331828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 629/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 12:02:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:04.337718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8f5fc-8bff-43c2-b3a5-2057e9c34153 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:04.403143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:04.439083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8f5fc-8bff-43c2-b3a5-2057e9c34153 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:04.472364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde4ed8-4027-411d-86fe-1c8a0482c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:04.472987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde4ed8-4027-411d-86fe-1c8a0482c335 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:04.473263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde4ed8-4027-411d-86fe-1c8a0482c335 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:04.473529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde4ed8-4027-411d-86fe-1c8a0482c335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:04.483662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde4ed8-4027-411d-86fe-1c8a0482c335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:04.485139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde4ed8-4027-411d-86fe-1c8a0482c335 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-efde4ed8-4027-411d-86fe-1c8a0482c335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:02:04.499521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:04.500611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:02:04.501942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:02:04.501942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:04.501942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:02:04.501942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 636/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:04.506750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270221b-7359-43c4-9bee-d2b906673f40 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:04.588056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:04.607179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270221b-7359-43c4-9bee-d2b906673f40 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:04.641131 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21565d8-bca1-428f-ab7a-cbb5ab13d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:04.641773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21565d8-bca1-428f-ab7a-cbb5ab13d890 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:04.642087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21565d8-bca1-428f-ab7a-cbb5ab13d890 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:04.642372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21565d8-bca1-428f-ab7a-cbb5ab13d890 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:04.643022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21565d8-bca1-428f-ab7a-cbb5ab13d890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:04.643400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21565d8-bca1-428f-ab7a-cbb5ab13d890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:04.644813 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21565d8-bca1-428f-ab7a-cbb5ab13d890 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:04.656805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 630/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:04.663608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde4ed8-4027-411d-86fe-1c8a0482c335 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:04.763208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde4ed8-4027-411d-86fe-1c8a0482c335 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:04.783795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:04.798000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4eda9-5783-4863-bde9-e54b5e79a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:04.798623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4eda9-5783-4863-bde9-e54b5e79a56c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:04.798897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4eda9-5783-4863-bde9-e54b5e79a56c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:04.799164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4eda9-5783-4863-bde9-e54b5e79a56c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:04.807023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4eda9-5783-4863-bde9-e54b5e79a56c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:04.808489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4eda9-5783-4863-bde9-e54b5e79a56c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e9c4eda9-5783-4863-bde9-e54b5e79a56c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 12:02:04.820000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:04.821539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:02:04.823392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 637/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:02:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:04.827066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21565d8-bca1-428f-ab7a-cbb5ab13d890 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:04.930599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21565d8-bca1-428f-ab7a-cbb5ab13d890 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:04.966450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12891fc3-a3b7-4655-8a32-fe8b5760a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:04.967055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12891fc3-a3b7-4655-8a32-fe8b5760a208 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:04.967331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12891fc3-a3b7-4655-8a32-fe8b5760a208 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:04.967602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12891fc3-a3b7-4655-8a32-fe8b5760a208 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:04.968358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12891fc3-a3b7-4655-8a32-fe8b5760a208 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:04.968662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12891fc3-a3b7-4655-8a32-fe8b5760a208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:04.970695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12891fc3-a3b7-4655-8a32-fe8b5760a208 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:04.979917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:04.988023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 631/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 1 12:02:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:04.993730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4eda9-5783-4863-bde9-e54b5e79a56c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:05.093152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4eda9-5783-4863-bde9-e54b5e79a56c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:05.128779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe197-41f7-4705-b66a-b7f2b0ac431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:05.129423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe197-41f7-4705-b66a-b7f2b0ac431e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:05.137678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe197-41f7-4705-b66a-b7f2b0ac431e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:05.137678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe197-41f7-4705-b66a-b7f2b0ac431e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:05.140454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fe197-41f7-4705-b66a-b7f2b0ac431e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:05.142428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fe197-41f7-4705-b66a-b7f2b0ac431e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-171fe197-41f7-4705-b66a-b7f2b0ac431e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:02:05.156441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:05.157432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:02:05.158376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:02:05.158376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:05.158376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:02:05.158376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 638/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:05.164077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12891fc3-a3b7-4655-8a32-fe8b5760a208 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:05.264690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12891fc3-a3b7-4655-8a32-fe8b5760a208 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:05.302351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de202a17-7070-4f03-b8f8-64903411e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:05.303026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de202a17-7070-4f03-b8f8-64903411e301 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:05.303327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de202a17-7070-4f03-b8f8-64903411e301 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:05.303604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de202a17-7070-4f03-b8f8-64903411e301 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:05.304282 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de202a17-7070-4f03-b8f8-64903411e301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:05.304588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de202a17-7070-4f03-b8f8-64903411e301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:05.305948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de202a17-7070-4f03-b8f8-64903411e301 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:05.318474 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 632/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:05.324340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe197-41f7-4705-b66a-b7f2b0ac431e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:05.357447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:05.428127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe197-41f7-4705-b66a-b7f2b0ac431e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:05.463783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57ffa6-d816-40ca-ad89-1875c1395d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:05.464440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57ffa6-d816-40ca-ad89-1875c1395d84 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:05.471067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57ffa6-d816-40ca-ad89-1875c1395d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:05.471067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57ffa6-d816-40ca-ad89-1875c1395d84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:05.471571 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57ffa6-d816-40ca-ad89-1875c1395d84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:05.473108 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57ffa6-d816-40ca-ad89-1875c1395d84 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-9e57ffa6-d816-40ca-ad89-1875c1395d84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 12:02:05.484309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:05.485854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:05.486899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 12:02:05.486899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 12:02:05.486899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 12:02:05.486899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 12:02:05.486899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 12:02:05.486899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 12:02:05.486899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:02:05.486899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:02:05.486899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 639/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 12:02:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:05.491869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de202a17-7070-4f03-b8f8-64903411e301 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:05.554665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:05.596237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de202a17-7070-4f03-b8f8-64903411e301 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:05.629597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf69fb-9b57-46bf-9e53-7a82e4416f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:05.630201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf69fb-9b57-46bf-9e53-7a82e4416f9b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:05.630483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf69fb-9b57-46bf-9e53-7a82e4416f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:05.630760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf69fb-9b57-46bf-9e53-7a82e4416f9b None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:05.631460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf69fb-9b57-46bf-9e53-7a82e4416f9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:05.631765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf69fb-9b57-46bf-9e53-7a82e4416f9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:05.633278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf69fb-9b57-46bf-9e53-7a82e4416f9b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:05.646851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 633/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 12:02:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:05.652956 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57ffa6-d816-40ca-ad89-1875c1395d84 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:05.746950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:05.757289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57ffa6-d816-40ca-ad89-1875c1395d84 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:05.791013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb22d3-9488-47b3-9ba6-f8f0910f405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:05.791708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb22d3-9488-47b3-9ba6-f8f0910f405d None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:05.792056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb22d3-9488-47b3-9ba6-f8f0910f405d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:05.792287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb22d3-9488-47b3-9ba6-f8f0910f405d None admin] PATH_INFO: `/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/81919eaf832b4025a2118feb4e7fe042/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:05.794196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb22d3-9488-47b3-9ba6-f8f0910f405d None admin] RBAC: Authorizing `identity:create_grant(project_id=39853b73f16840a9aac4e60ccb8cccc7, user_id=81919eaf832b4025a2118feb4e7fe042, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:05.795617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb22d3-9488-47b3-9ba6-f8f0910f405d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:05.931259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 640/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Sep 1 12:02:05 2022] PUT /identity/v3/projects/39853b73f16840a9aac4e60ccb8cccc7/users/81919eaf832b4025a2118feb4e7fe042/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:02:07.849596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e90d57-76f7-416c-989c-7eef99ee1a8e None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:07.850152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e90d57-76f7-416c-989c-7eef99ee1a8e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:07.850152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e90d57-76f7-416c-989c-7eef99ee1a8e None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:07.851498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 634/1274] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:02:07.857066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef712a65-7059-4f99-b7c7-dfceb6fa1c49 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:07.857528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef712a65-7059-4f99-b7c7-dfceb6fa1c49 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:07.857623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef712a65-7059-4f99-b7c7-dfceb6fa1c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:07.876711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ef712a65-7059-4f99-b7c7-dfceb6fa1c49 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:02:07.877910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ef712a65-7059-4f99-b7c7-dfceb6fa1c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:02:07.945079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 641/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:02:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:02:08.213095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e90d57-76f7-416c-989c-7eef99ee1a8e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:08.316234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e90d57-76f7-416c-989c-7eef99ee1a8e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:08.333280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:08.351144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9788cf4-a18d-4335-860f-8affc5c99d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:08.352160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9788cf4-a18d-4335-860f-8affc5c99d3b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:08.352473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9788cf4-a18d-4335-860f-8affc5c99d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:08.355723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9788cf4-a18d-4335-860f-8affc5c99d3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:08.366278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9788cf4-a18d-4335-860f-8affc5c99d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c9788cf4-a18d-4335-860f-8affc5c99d3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 12:02:08.371456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:08.372584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:08.373600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 635/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Sep 1 12:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:08.378798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef712a65-7059-4f99-b7c7-dfceb6fa1c49 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:08.462700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:08.481750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef712a65-7059-4f99-b7c7-dfceb6fa1c49 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:08.517089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf36283-b111-46cb-9b7a-2efc5d4f8707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:08.517676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf36283-b111-46cb-9b7a-2efc5d4f8707 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:08.517960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf36283-b111-46cb-9b7a-2efc5d4f8707 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:08.518239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf36283-b111-46cb-9b7a-2efc5d4f8707 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:08.518906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf36283-b111-46cb-9b7a-2efc5d4f8707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:08.519221 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf36283-b111-46cb-9b7a-2efc5d4f8707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:08.521118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf36283-b111-46cb-9b7a-2efc5d4f8707 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:08.529122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 642/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Sep 1 12:02:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:02:08.535875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9788cf4-a18d-4335-860f-8affc5c99d3b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:08.634980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9788cf4-a18d-4335-860f-8affc5c99d3b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:08.670853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7d57d-7a20-4dd2-a16f-d8c71c02f351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:08.671483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7d57d-7a20-4dd2-a16f-d8c71c02f351 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:08.671803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7d57d-7a20-4dd2-a16f-d8c71c02f351 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:08.672044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7d57d-7a20-4dd2-a16f-d8c71c02f351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:08.683219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7d57d-7a20-4dd2-a16f-d8c71c02f351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:08.683840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7d57d-7a20-4dd2-a16f-d8c71c02f351 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a7a7d57d-7a20-4dd2-a16f-d8c71c02f351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:02:08.699159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:08.706205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:02:08.707085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:02:08.707085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:08.707085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:08.707085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 636/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:08.707319 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf36283-b111-46cb-9b7a-2efc5d4f8707 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:08.818234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf36283-b111-46cb-9b7a-2efc5d4f8707 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:08.857263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea148de-ab91-42a6-b079-2d51085d418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:08.857981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea148de-ab91-42a6-b079-2d51085d418c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:08.858181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea148de-ab91-42a6-b079-2d51085d418c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:08.858451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea148de-ab91-42a6-b079-2d51085d418c None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:08.859164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea148de-ab91-42a6-b079-2d51085d418c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:08.859470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea148de-ab91-42a6-b079-2d51085d418c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:08.860959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea148de-ab91-42a6-b079-2d51085d418c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:08.874011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 643/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:08.880773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7d57d-7a20-4dd2-a16f-d8c71c02f351 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:08.914292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:08.987283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7d57d-7a20-4dd2-a16f-d8c71c02f351 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:09.023747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4bbcb-1ef5-44b0-8e8b-47f4eb3475f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:09.024407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4bbcb-1ef5-44b0-8e8b-47f4eb3475f2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:09.024688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4bbcb-1ef5-44b0-8e8b-47f4eb3475f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:09.024959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4bbcb-1ef5-44b0-8e8b-47f4eb3475f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:09.032125 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4bbcb-1ef5-44b0-8e8b-47f4eb3475f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:09.033674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4bbcb-1ef5-44b0-8e8b-47f4eb3475f2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e8d4bbcb-1ef5-44b0-8e8b-47f4eb3475f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 12:02:09.046012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:09.050550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:09.051913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 637/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:02:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:09.053334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea148de-ab91-42a6-b079-2d51085d418c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:09.058095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:09.157778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea148de-ab91-42a6-b079-2d51085d418c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:09.191938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346ff7e-b46b-4c83-9c09-d7f42b9b116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:09.192749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346ff7e-b46b-4c83-9c09-d7f42b9b116b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:09.195663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346ff7e-b46b-4c83-9c09-d7f42b9b116b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:09.195663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346ff7e-b46b-4c83-9c09-d7f42b9b116b None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:09.195663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346ff7e-b46b-4c83-9c09-d7f42b9b116b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:09.195663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346ff7e-b46b-4c83-9c09-d7f42b9b116b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:09.196741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346ff7e-b46b-4c83-9c09-d7f42b9b116b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:09.214619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 644/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Sep 1 12:02:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:09.220545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4bbcb-1ef5-44b0-8e8b-47f4eb3475f2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:09.312318 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:09.322461 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4bbcb-1ef5-44b0-8e8b-47f4eb3475f2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:09.357025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6f5af-34c9-43a4-8071-82023e25ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:09.357633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f5af-34c9-43a4-8071-82023e25ddb3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:09.357903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f5af-34c9-43a4-8071-82023e25ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:09.358173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f5af-34c9-43a4-8071-82023e25ddb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:09.424696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6f5af-34c9-43a4-8071-82023e25ddb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:09.426044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6f5af-34c9-43a4-8071-82023e25ddb3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:09.515472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:09.525809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 638/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Sep 1 12:02:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 12:02:09.531916 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346ff7e-b46b-4c83-9c09-d7f42b9b116b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:09.592592 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:09.631416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346ff7e-b46b-4c83-9c09-d7f42b9b116b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:09.666530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3ebe3-72e2-4400-917f-6c3a253e6b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:09.667159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3ebe3-72e2-4400-917f-6c3a253e6b3e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:09.667440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3ebe3-72e2-4400-917f-6c3a253e6b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:09.667718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3ebe3-72e2-4400-917f-6c3a253e6b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:09.678798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3ebe3-72e2-4400-917f-6c3a253e6b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:09.680281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3ebe3-72e2-4400-917f-6c3a253e6b3e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-53d3ebe3-72e2-4400-917f-6c3a253e6b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 12:02:09.696791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:09.698053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 12:02:09.699122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 12:02:09.699122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 12:02:09.699122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:02:09.699122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 645/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:09.703930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6f5af-34c9-43a4-8071-82023e25ddb3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:09.803572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6f5af-34c9-43a4-8071-82023e25ddb3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:09.838825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7315263-8d0f-4bd4-b547-778585402951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:09.839915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7315263-8d0f-4bd4-b547-778585402951 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:09.840197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7315263-8d0f-4bd4-b547-778585402951 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:09.840551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7315263-8d0f-4bd4-b547-778585402951 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:09.841201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7315263-8d0f-4bd4-b547-778585402951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:09.841501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7315263-8d0f-4bd4-b547-778585402951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:09.842897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7315263-8d0f-4bd4-b547-778585402951 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:09.854865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 639/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Sep 1 12:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:09.861395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3ebe3-72e2-4400-917f-6c3a253e6b3e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:09.961678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3ebe3-72e2-4400-917f-6c3a253e6b3e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:09.975451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:09.994827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7b16-d70d-4601-8728-ec15affff06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:09.995444 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7b16-d70d-4601-8728-ec15affff06a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:09.997998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7b16-d70d-4601-8728-ec15affff06a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:09.997998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc7b16-d70d-4601-8728-ec15affff06a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:10.002374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7b16-d70d-4601-8728-ec15affff06a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:10.003819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc7b16-d70d-4601-8728-ec15affff06a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c9bc7b16-d70d-4601-8728-ec15affff06a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 12:02:10.015921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:10.017512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:10.018540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 12:02:10.018540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 12:02:10.018540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 12:02:10.018540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 12:02:10.018540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 12:02:10.018540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 12:02:10.018540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 12:02:10.018540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 01 12:02:10.018540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 646/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Sep 1 12:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:10.023586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7315263-8d0f-4bd4-b547-778585402951 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:10.074538 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:10.122709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7315263-8d0f-4bd4-b547-778585402951 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:10.162132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7abeb-12f5-4263-bc65-f7587340d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:10.162733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7abeb-12f5-4263-bc65-f7587340d3ab None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:10.163007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7abeb-12f5-4263-bc65-f7587340d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:10.163277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7abeb-12f5-4263-bc65-f7587340d3ab None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:10.163960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7abeb-12f5-4263-bc65-f7587340d3ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:10.164287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7abeb-12f5-4263-bc65-f7587340d3ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:10.172287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7abeb-12f5-4263-bc65-f7587340d3ab None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:10.178340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 640/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Sep 1 12:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:10.184708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7b16-d70d-4601-8728-ec15affff06a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:10.285074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc7b16-d70d-4601-8728-ec15affff06a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:10.318644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234c301-c2f2-4750-b7e7-4ff763730470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:10.319254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234c301-c2f2-4750-b7e7-4ff763730470 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:10.319532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234c301-c2f2-4750-b7e7-4ff763730470 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:10.319805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234c301-c2f2-4750-b7e7-4ff763730470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:10.320656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234c301-c2f2-4750-b7e7-4ff763730470 None admin] RBAC: Adding query filter params (role.id=aee8b5d036dd4bec8d6aeae1d35e59a8, scope.project.id=39853b73f16840a9aac4e60ccb8cccc7, user.id=81919eaf832b4025a2118feb4e7fe042) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:10.320962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234c301-c2f2-4750-b7e7-4ff763730470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:10.322402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234c301-c2f2-4750-b7e7-4ff763730470 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:10.328575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 647/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Sep 1 12:02:10 2022] GET /identity/v3/role_assignments?user.id=81919eaf832b4025a2118feb4e7fe042&scope.project.id=39853b73f16840a9aac4e60ccb8cccc7&role.id=aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:12.295757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b789-8363-4ccd-90a5-3572e8a35055 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:12.296371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b789-8363-4ccd-90a5-3572e8a35055 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:12.296371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b789-8363-4ccd-90a5-3572e8a35055 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:12.297821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 641/1288] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:02:12.303575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1585d-0bba-48ea-b8dc-8f45e9b01fa8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:12.304068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1585d-0bba-48ea-b8dc-8f45e9b01fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:12.304174 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1585d-0bba-48ea-b8dc-8f45e9b01fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:12.322332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e3d1585d-0bba-48ea-b8dc-8f45e9b01fa8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:02:12.323514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e3d1585d-0bba-48ea-b8dc-8f45e9b01fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:02:12.353196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:12.389225 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 648/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:02:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 12:02:12.660374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0b789-8363-4ccd-90a5-3572e8a35055 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:12.763691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0b789-8363-4ccd-90a5-3572e8a35055 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:12.776375 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:12.802829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a1bb9-c5fe-43cd-ba96-28db87df614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:12.803484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a1bb9-c5fe-43cd-ba96-28db87df614e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:12.803765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a1bb9-c5fe-43cd-ba96-28db87df614e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:12.804038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a1bb9-c5fe-43cd-ba96-28db87df614e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:12.804649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a1bb9-c5fe-43cd-ba96-28db87df614e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:12.806011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a1bb9-c5fe-43cd-ba96-28db87df614e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-241a1bb9-c5fe-43cd-ba96-28db87df614e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:12.815316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:12.816567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:12.817572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 642/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 1 12:02:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:12.822649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1585d-0bba-48ea-b8dc-8f45e9b01fa8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:12.923651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1585d-0bba-48ea-b8dc-8f45e9b01fa8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:12.959215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f7fd1-b0cf-4743-acc2-41d9ea7e2202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:12.959823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7fd1-b0cf-4743-acc2-41d9ea7e2202 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:12.960102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7fd1-b0cf-4743-acc2-41d9ea7e2202 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:12.960404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7fd1-b0cf-4743-acc2-41d9ea7e2202 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:12.961042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f7fd1-b0cf-4743-acc2-41d9ea7e2202 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:12.961345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f7fd1-b0cf-4743-acc2-41d9ea7e2202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:12.962720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f7fd1-b0cf-4743-acc2-41d9ea7e2202 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:12.968930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 649/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Sep 1 12:02:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:12.973935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a1bb9-c5fe-43cd-ba96-28db87df614e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:13.076444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a1bb9-c5fe-43cd-ba96-28db87df614e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:13.109161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d91e5-9c93-4ad0-b13b-efcfe8e4e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:13.109762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d91e5-9c93-4ad0-b13b-efcfe8e4e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:13.110030 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d91e5-9c93-4ad0-b13b-efcfe8e4e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:13.114457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d91e5-9c93-4ad0-b13b-efcfe8e4e1e7 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:13.114457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d91e5-9c93-4ad0-b13b-efcfe8e4e1e7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:13.114457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d91e5-9c93-4ad0-b13b-efcfe8e4e1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:13.114457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d91e5-9c93-4ad0-b13b-efcfe8e4e1e7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:13.117510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 643/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Sep 1 12:02:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:15.024366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e801cab-8fd6-4675-94db-f289d6fd8862 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:15.024366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e801cab-8fd6-4675-94db-f289d6fd8862 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:15.024949 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e801cab-8fd6-4675-94db-f289d6fd8862 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:15.025935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 650/1293] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:02:15.031552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8f35-e6f8-40f9-9a80-371cb361a2d8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:15.032010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8f35-e6f8-40f9-9a80-371cb361a2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:15.032107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8f35-e6f8-40f9-9a80-371cb361a2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:15.052463 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-26fb8f35-e6f8-40f9-9a80-371cb361a2d8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:02:15.060492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-26fb8f35-e6f8-40f9-9a80-371cb361a2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:02:15.090400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:15.130440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 644/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:02:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:02:15.397896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e801cab-8fd6-4675-94db-f289d6fd8862 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:15.430181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:15.501382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e801cab-8fd6-4675-94db-f289d6fd8862 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:15.536027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10091e-2dc3-4761-bf05-342c85672793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:15.536654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10091e-2dc3-4761-bf05-342c85672793 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:15.536931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10091e-2dc3-4761-bf05-342c85672793 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:15.537235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10091e-2dc3-4761-bf05-342c85672793 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:15.537901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10091e-2dc3-4761-bf05-342c85672793 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:15.539238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10091e-2dc3-4761-bf05-342c85672793 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:15.657330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 651/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Sep 1 12:02:15 2022] POST /identity/v3/services => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:02:17.566656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53753987-ba67-41a5-aae3-8ea039948553 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:17.567188 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53753987-ba67-41a5-aae3-8ea039948553 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:17.567188 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53753987-ba67-41a5-aae3-8ea039948553 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:17.568580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 645/1296] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:02:17.573701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b72a7d-c481-4af0-a29d-da5c2dfc8ec0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:17.579604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b72a7d-c481-4af0-a29d-da5c2dfc8ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:17.579604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b72a7d-c481-4af0-a29d-da5c2dfc8ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:17.591991 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-18b72a7d-c481-4af0-a29d-da5c2dfc8ec0 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:02:17.593212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-18b72a7d-c481-4af0-a29d-da5c2dfc8ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:02:17.663975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 652/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:02:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:02:17.934295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53753987-ba67-41a5-aae3-8ea039948553 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:18.033366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53753987-ba67-41a5-aae3-8ea039948553 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:18.068756 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7181-fe3e-41d6-948b-99d6846e2163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:18.069381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7181-fe3e-41d6-948b-99d6846e2163 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:18.069659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7181-fe3e-41d6-948b-99d6846e2163 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:18.069944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7181-fe3e-41d6-948b-99d6846e2163 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:18.070588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e7181-fe3e-41d6-948b-99d6846e2163 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:18.071967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e7181-fe3e-41d6-948b-99d6846e2163 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-570e7181-fe3e-41d6-948b-99d6846e2163 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:18.080695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:18.081862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:18.082758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 646/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 1 12:02:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:18.089905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b72a7d-c481-4af0-a29d-da5c2dfc8ec0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:18.110982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:18.189253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b72a7d-c481-4af0-a29d-da5c2dfc8ec0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:18.223014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac47e3-fa1f-49d1-b986-f35a4afc5904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:18.223608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac47e3-fa1f-49d1-b986-f35a4afc5904 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:18.223882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac47e3-fa1f-49d1-b986-f35a4afc5904 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:18.224149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac47e3-fa1f-49d1-b986-f35a4afc5904 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:18.224798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac47e3-fa1f-49d1-b986-f35a4afc5904 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:18.225098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac47e3-fa1f-49d1-b986-f35a4afc5904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:18.226442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac47e3-fa1f-49d1-b986-f35a4afc5904 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:18.231485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 653/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Sep 1 12:02:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:18.237663 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7181-fe3e-41d6-948b-99d6846e2163 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:18.268815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:18.336533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7181-fe3e-41d6-948b-99d6846e2163 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:18.369046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a90db-89c5-4852-a486-ddb1f71cf81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:18.369682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a90db-89c5-4852-a486-ddb1f71cf81d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:18.369961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a90db-89c5-4852-a486-ddb1f71cf81d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:18.370273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a90db-89c5-4852-a486-ddb1f71cf81d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:18.370975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a90db-89c5-4852-a486-ddb1f71cf81d None admin] RBAC: Adding query filter params (interface=public, service_id=a97bdbb4b46f428cb963daa2319fec0f, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:18.371278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a90db-89c5-4852-a486-ddb1f71cf81d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:18.372647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a90db-89c5-4852-a486-ddb1f71cf81d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:18.377599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 647/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Sep 1 12:02:18 2022] GET /identity/v3/endpoints?service_id=a97bdbb4b46f428cb963daa2319fec0f&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:18.383789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac47e3-fa1f-49d1-b986-f35a4afc5904 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:18.465032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:18.482574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac47e3-fa1f-49d1-b986-f35a4afc5904 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:18.514523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36090511-b6a0-419c-a5a3-efa4acddac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:18.515114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36090511-b6a0-419c-a5a3-efa4acddac00 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:18.515391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36090511-b6a0-419c-a5a3-efa4acddac00 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:18.515663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36090511-b6a0-419c-a5a3-efa4acddac00 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:18.516278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36090511-b6a0-419c-a5a3-efa4acddac00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:18.517647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36090511-b6a0-419c-a5a3-efa4acddac00 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:18.524760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 654/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Sep 1 12:02:18 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:02:20.422345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ac71-32ab-4046-8a72-c3227a19ba53 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:20.422876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ac71-32ab-4046-8a72-c3227a19ba53 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:20.422876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ac71-32ab-4046-8a72-c3227a19ba53 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:20.424968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 648/1302] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:02:20.430040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441d2d3-2f25-4a78-a7bb-feef2b1db0a8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:20.430460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441d2d3-2f25-4a78-a7bb-feef2b1db0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:20.430605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441d2d3-2f25-4a78-a7bb-feef2b1db0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:20.449090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5441d2d3-2f25-4a78-a7bb-feef2b1db0a8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:02:20.450361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5441d2d3-2f25-4a78-a7bb-feef2b1db0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:02:20.516461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 655/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:02:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 12:02:20.782602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ac71-32ab-4046-8a72-c3227a19ba53 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:20.886591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:20.894312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ac71-32ab-4046-8a72-c3227a19ba53 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:20.929991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f5dba-2be7-4d2e-b2d9-7d6257049369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:20.930588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f5dba-2be7-4d2e-b2d9-7d6257049369 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:20.930865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f5dba-2be7-4d2e-b2d9-7d6257049369 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:20.931139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f5dba-2be7-4d2e-b2d9-7d6257049369 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:20.931732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f5dba-2be7-4d2e-b2d9-7d6257049369 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:20.933194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f5dba-2be7-4d2e-b2d9-7d6257049369 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b96f5dba-2be7-4d2e-b2d9-7d6257049369 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 12:02:20.943126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 12:02:20.944339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 01 12:02:20.945176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 649/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Sep 1 12:02:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 12:02:20.950507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441d2d3-2f25-4a78-a7bb-feef2b1db0a8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:21.028937 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:21.052413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441d2d3-2f25-4a78-a7bb-feef2b1db0a8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:21.088175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287374e6-d831-4b43-9c8c-71578e4b3ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:21.088814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287374e6-d831-4b43-9c8c-71578e4b3ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:21.089089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287374e6-d831-4b43-9c8c-71578e4b3ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:21.089358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287374e6-d831-4b43-9c8c-71578e4b3ff4 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:21.089985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287374e6-d831-4b43-9c8c-71578e4b3ff4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:02:21.090292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287374e6-d831-4b43-9c8c-71578e4b3ff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:21.091645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287374e6-d831-4b43-9c8c-71578e4b3ff4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:21.096863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 656/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Sep 1 12:02:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:02:21.102769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f5dba-2be7-4d2e-b2d9-7d6257049369 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:02:21.204804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f5dba-2be7-4d2e-b2d9-7d6257049369 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:02:21.245835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd265dc2-aa73-4aa4-be54-e61dec7d3053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:02:21.246448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265dc2-aa73-4aa4-be54-e61dec7d3053 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:02:21.246784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265dc2-aa73-4aa4-be54-e61dec7d3053 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:02:21.247055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265dc2-aa73-4aa4-be54-e61dec7d3053 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:02:21.247714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd265dc2-aa73-4aa4-be54-e61dec7d3053 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:02:21.249085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd265dc2-aa73-4aa4-be54-e61dec7d3053 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:02:21.396811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 650/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:02:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:02:31.107401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=30 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:02:31.392015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:37.227130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3a83-3bbc-4036-85a3-dc9c1e766007 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:37.228050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3a83-3bbc-4036-85a3-dc9c1e766007 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:37.228513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3a83-3bbc-4036-85a3-dc9c1e766007 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:37.236013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257d4ac-681e-47ef-876f-47842b00f3fc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:37.236895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257d4ac-681e-47ef-876f-47842b00f3fc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:37.237339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257d4ac-681e-47ef-876f-47842b00f3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:37.242147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 657/1307] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:10:37 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:10:37.326542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8257d4ac-681e-47ef-876f-47842b00f3fc None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:10:37.328002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8257d4ac-681e-47ef-876f-47842b00f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:37.460239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 651/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:10:37.766922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ea258-cefd-4b96-b87c-fd4c52753ed5 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:37.767212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ea258-cefd-4b96-b87c-fd4c52753ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:37.767491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ea258-cefd-4b96-b87c-fd4c52753ed5 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:37.769207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 658/1309] 10.222.0.18 () {54 vars in 965 bytes} [Thu Sep 1 12:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:10:37.781499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dd43f-b343-43e1-810b-de8bdce57554 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:37.782096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dd43f-b343-43e1-810b-de8bdce57554 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:37.782570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dd43f-b343-43e1-810b-de8bdce57554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:37.956562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ac3dd43f-b343-43e1-810b-de8bdce57554 None None] MFA Rules not processed for user `d0eb27228bae4b6d97715c0c46032030`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:10:37.960035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ac3dd43f-b343-43e1-810b-de8bdce57554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:38.003279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:38.078570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 652/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Thu Sep 1 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:10:38.088198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ea258-cefd-4b96-b87c-fd4c52753ed5 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:10:38.090309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d44ea258-cefd-4b96-b87c-fd4c52753ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:38.260074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ea258-cefd-4b96-b87c-fd4c52753ed5 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:10:38.359326 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70525f3e-bee3-4224-a2bd-c442579a40a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:10:38.359951 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70525f3e-bee3-4224-a2bd-c442579a40a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:38.360304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70525f3e-bee3-4224-a2bd-c442579a40a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:38.360579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70525f3e-bee3-4224-a2bd-c442579a40a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:38.362257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-70525f3e-bee3-4224-a2bd-c442579a40a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:38.429164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:38.493570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70525f3e-bee3-4224-a2bd-c442579a40a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:10:38.495322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70525f3e-bee3-4224-a2bd-c442579a40a4 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:10:38.519563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 659/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:10:40.750484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc376c-ebc1-4966-838f-4d9f696fc39d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:40.751015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc376c-ebc1-4966-838f-4d9f696fc39d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:40.751015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc376c-ebc1-4966-838f-4d9f696fc39d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:40.752409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 653/1312] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:10:40.757520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504174f2-4799-44b7-9e63-8fe59449f528 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:40.757978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504174f2-4799-44b7-9e63-8fe59449f528 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:40.758082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504174f2-4799-44b7-9e63-8fe59449f528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:40.843867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-504174f2-4799-44b7-9e63-8fe59449f528 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:10:40.845256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-504174f2-4799-44b7-9e63-8fe59449f528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:40.949514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 660/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:10:41.235179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc376c-ebc1-4966-838f-4d9f696fc39d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:10:41.236768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-84cc376c-ebc1-4966-838f-4d9f696fc39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:41.350704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc376c-ebc1-4966-838f-4d9f696fc39d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:10:41.422245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:41.424840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee7d25-9680-4b95-be04-3865f2167c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:10:41.425447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee7d25-9680-4b95-be04-3865f2167c2f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:41.425718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee7d25-9680-4b95-be04-3865f2167c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:41.425988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee7d25-9680-4b95-be04-3865f2167c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:41.427611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-63ee7d25-9680-4b95-be04-3865f2167c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:41.539121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee7d25-9680-4b95-be04-3865f2167c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:10:41.540486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee7d25-9680-4b95-be04-3865f2167c2f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:10:41.560666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 654/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:10:44.313187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f88d-375a-4a79-84b6-7f9d5f3dfc14 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:44.313810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f88d-375a-4a79-84b6-7f9d5f3dfc14 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:44.313810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f88d-375a-4a79-84b6-7f9d5f3dfc14 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:44.315068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 661/1315] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:10:44.321213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa613e1-0bf7-4911-92de-d332c1e972c9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:44.321665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa613e1-0bf7-4911-92de-d332c1e972c9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:44.321777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa613e1-0bf7-4911-92de-d332c1e972c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:44.391238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cfa613e1-0bf7-4911-92de-d332c1e972c9 None None] MFA Rules not processed for user `d06ec2bc25fe49a7b6a30ea0cfc828a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:10:44.392500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cfa613e1-0bf7-4911-92de-d332c1e972c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:44.447563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:44.490807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 655/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:10:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:10:44.792655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba482f3-c5d4-40f2-ba89-2599f6fcb1ac None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:44.792935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba482f3-c5d4-40f2-ba89-2599f6fcb1ac None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:44.793212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba482f3-c5d4-40f2-ba89-2599f6fcb1ac None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:44.795070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 662/1317] 10.222.0.18 () {54 vars in 965 bytes} [Thu Sep 1 12:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:10:44.801054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045887d6-ee53-4b99-8c63-e0de246ff96b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:44.801333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045887d6-ee53-4b99-8c63-e0de246ff96b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:44.801604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045887d6-ee53-4b99-8c63-e0de246ff96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:44.880197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-045887d6-ee53-4b99-8c63-e0de246ff96b None None] MFA Rules not processed for user `d0eb27228bae4b6d97715c0c46032030`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:10:44.881479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-045887d6-ee53-4b99-8c63-e0de246ff96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:44.960574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 656/1318] 10.222.0.18 () {58 vars in 1062 bytes} [Thu Sep 1 12:10:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:10:44.969714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba482f3-c5d4-40f2-ba89-2599f6fcb1ac None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:10:44.971369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-eba482f3-c5d4-40f2-ba89-2599f6fcb1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:44.983374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:45.078564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba482f3-c5d4-40f2-ba89-2599f6fcb1ac None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:10:45.155057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ae104-7d98-47e5-b2e8-c60e612248ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:10:45.155662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ae104-7d98-47e5-b2e8-c60e612248ee service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:45.155942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ae104-7d98-47e5-b2e8-c60e612248ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:45.156259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ae104-7d98-47e5-b2e8-c60e612248ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:45.157974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-369ae104-7d98-47e5-b2e8-c60e612248ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:45.221211 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:45.266557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ae104-7d98-47e5-b2e8-c60e612248ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:10:45.267975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ae104-7d98-47e5-b2e8-c60e612248ee service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:10:45.286984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 663/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:10:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:10:48.397141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748752a-5027-4a75-a65a-52eaef0ce5d4 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:48.397703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748752a-5027-4a75-a65a-52eaef0ce5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:48.397703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748752a-5027-4a75-a65a-52eaef0ce5d4 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:48.399218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 657/1320] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:10:48.405070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1a416-2c1a-48f1-93c0-35ad090b8a46 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:48.405559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1a416-2c1a-48f1-93c0-35ad090b8a46 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:48.405669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1a416-2c1a-48f1-93c0-35ad090b8a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:48.484029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-28a1a416-2c1a-48f1-93c0-35ad090b8a46 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:10:48.485325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-28a1a416-2c1a-48f1-93c0-35ad090b8a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:48.590793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 664/1321] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:10:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:10:48.873935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748752a-5027-4a75-a65a-52eaef0ce5d4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:10:48.875507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b748752a-5027-4a75-a65a-52eaef0ce5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:48.926355 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:48.983118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748752a-5027-4a75-a65a-52eaef0ce5d4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:10:49.056814 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acb953-ca15-45c0-a5b1-27c09dafee76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:10:49.057429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb953-ca15-45c0-a5b1-27c09dafee76 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:49.057709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb953-ca15-45c0-a5b1-27c09dafee76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:49.057985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb953-ca15-45c0-a5b1-27c09dafee76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:49.060141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a3acb953-ca15-45c0-a5b1-27c09dafee76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:49.161129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:49.174423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acb953-ca15-45c0-a5b1-27c09dafee76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:10:49.175853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acb953-ca15-45c0-a5b1-27c09dafee76 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:10:49.194275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 658/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:10:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:10:52.164400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f591-d9e7-4b41-95cb-dbedc7bfa9eb None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:52.164943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f591-d9e7-4b41-95cb-dbedc7bfa9eb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:52.165035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f591-d9e7-4b41-95cb-dbedc7bfa9eb None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:52.166475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 665/1323] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:10:52.171886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188297-e90e-4f22-ab3c-5aad6334fcb9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:52.172347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188297-e90e-4f22-ab3c-5aad6334fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:52.172483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188297-e90e-4f22-ab3c-5aad6334fcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:52.244311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-43188297-e90e-4f22-ab3c-5aad6334fcb9 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:10:52.245566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-43188297-e90e-4f22-ab3c-5aad6334fcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:52.361066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 659/1324] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:10:52.650409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241f591-d9e7-4b41-95cb-dbedc7bfa9eb None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:10:52.652011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a241f591-d9e7-4b41-95cb-dbedc7bfa9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:52.683279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:52.801804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241f591-d9e7-4b41-95cb-dbedc7bfa9eb None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:10:52.890046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc67d99-b440-4029-af2c-9b190d05fad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:10:52.890659 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67d99-b440-4029-af2c-9b190d05fad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:52.890938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67d99-b440-4029-af2c-9b190d05fad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:52.891214 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67d99-b440-4029-af2c-9b190d05fad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:52.892922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9bc67d99-b440-4029-af2c-9b190d05fad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:52.973752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:53.015179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc67d99-b440-4029-af2c-9b190d05fad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:10:53.016875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc67d99-b440-4029-af2c-9b190d05fad3 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:10:53.036446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 666/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:10:55.039631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658399-21f4-4426-a14c-45da040c5cdd None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:55.040144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658399-21f4-4426-a14c-45da040c5cdd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:55.040144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658399-21f4-4426-a14c-45da040c5cdd None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:55.041458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 660/1326] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 12:10:55.047851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f985-8283-404c-8a30-60f1c2cc5da8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:55.048564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f985-8283-404c-8a30-60f1c2cc5da8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:55.048564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f985-8283-404c-8a30-60f1c2cc5da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:55.118055 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d010f985-8283-404c-8a30-60f1c2cc5da8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:10:55.119305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d010f985-8283-404c-8a30-60f1c2cc5da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:55.229958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 667/1327] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:10:55.515618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658399-21f4-4426-a14c-45da040c5cdd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:10:55.518335 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10658399-21f4-4426-a14c-45da040c5cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:55.624094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:55.700797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658399-21f4-4426-a14c-45da040c5cdd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:10:55.780928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9c34a-e258-4a0d-8a10-3e91ea9d5d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:10:55.781549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9c34a-e258-4a0d-8a10-3e91ea9d5d98 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:55.781848 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9c34a-e258-4a0d-8a10-3e91ea9d5d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:55.782127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9c34a-e258-4a0d-8a10-3e91ea9d5d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:55.783768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ceb9c34a-e258-4a0d-8a10-3e91ea9d5d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:55.921458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:55.923820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9c34a-e258-4a0d-8a10-3e91ea9d5d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:10:55.925310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9c34a-e258-4a0d-8a10-3e91ea9d5d98 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:10:55.944117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 661/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:10:57.943865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac5795-51ca-465c-8d9b-efe47dc5ecba None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:57.944407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac5795-51ca-465c-8d9b-efe47dc5ecba None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:57.944407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac5795-51ca-465c-8d9b-efe47dc5ecba None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:57.945742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 668/1329] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:10:57.951147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb3845-dd97-4fe2-b8bf-3d51b132fb6b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:57.951613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb3845-dd97-4fe2-b8bf-3d51b132fb6b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:57.951856 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb3845-dd97-4fe2-b8bf-3d51b132fb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:58.020383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-14eb3845-dd97-4fe2-b8bf-3d51b132fb6b None None] MFA Rules not processed for user `d06ec2bc25fe49a7b6a30ea0cfc828a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:10:58.021597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-14eb3845-dd97-4fe2-b8bf-3d51b132fb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:58.123249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 662/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:10:58.407720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac5795-51ca-465c-8d9b-efe47dc5ecba None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:10:58.409392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1fac5795-51ca-465c-8d9b-efe47dc5ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:58.440832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:58.516264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac5795-51ca-465c-8d9b-efe47dc5ecba None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:10:58.589500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126deb92-d8ea-4e4d-9575-41ca165470ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:10:58.590573 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126deb92-d8ea-4e4d-9575-41ca165470ea service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:10:58.590853 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126deb92-d8ea-4e4d-9575-41ca165470ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:10:58.591125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126deb92-d8ea-4e4d-9575-41ca165470ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:10:58.592753 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-126deb92-d8ea-4e4d-9575-41ca165470ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:10:58.671255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:10:58.706934 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126deb92-d8ea-4e4d-9575-41ca165470ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:10:58.708410 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126deb92-d8ea-4e4d-9575-41ca165470ea service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:10:58.726222 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 669/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:10:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:01.047327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe300-bfb7-417f-b515-297dc959971a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:01.047870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe300-bfb7-417f-b515-297dc959971a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:01.047870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe300-bfb7-417f-b515-297dc959971a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:01.049228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 663/1332] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:01.054593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872c05-dd18-42f3-b490-83e58b090212 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:01.054990 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872c05-dd18-42f3-b490-83e58b090212 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:01.055147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872c05-dd18-42f3-b490-83e58b090212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:01.123347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a9872c05-dd18-42f3-b490-83e58b090212 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:01.124601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a9872c05-dd18-42f3-b490-83e58b090212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:01.222514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 670/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:01.508446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbe300-bfb7-417f-b515-297dc959971a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:01.510028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-39fbe300-bfb7-417f-b515-297dc959971a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:01.581216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:01.614602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbe300-bfb7-417f-b515-297dc959971a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:01.687536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239881c7-cc25-4ad7-bbb0-7fde407c678c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:01.688147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239881c7-cc25-4ad7-bbb0-7fde407c678c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:01.688452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239881c7-cc25-4ad7-bbb0-7fde407c678c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:01.688725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239881c7-cc25-4ad7-bbb0-7fde407c678c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:01.690326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-239881c7-cc25-4ad7-bbb0-7fde407c678c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:01.804961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239881c7-cc25-4ad7-bbb0-7fde407c678c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:01.806437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239881c7-cc25-4ad7-bbb0-7fde407c678c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:01.817783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:01.826615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 664/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:03.777788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05242e96-d4fb-4703-9afd-4d7282690fa4 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:03.778346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05242e96-d4fb-4703-9afd-4d7282690fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:03.778346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05242e96-d4fb-4703-9afd-4d7282690fa4 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:03.779694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 671/1335] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:03.785324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3adca-ecfc-4146-ad73-a3c8fec85872 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:03.785924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3adca-ecfc-4146-ad73-a3c8fec85872 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:03.785924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3adca-ecfc-4146-ad73-a3c8fec85872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:03.853529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-31c3adca-ecfc-4146-ad73-a3c8fec85872 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:03.854674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-31c3adca-ecfc-4146-ad73-a3c8fec85872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:03.953242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 665/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:11:04.238863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05242e96-d4fb-4703-9afd-4d7282690fa4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:04.240432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-05242e96-d4fb-4703-9afd-4d7282690fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:04.283293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:04.348231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05242e96-d4fb-4703-9afd-4d7282690fa4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:04.423951 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a40cf3-ea07-424e-89cc-c0aaa012e311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:04.424593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a40cf3-ea07-424e-89cc-c0aaa012e311 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:04.424871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a40cf3-ea07-424e-89cc-c0aaa012e311 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:04.425142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a40cf3-ea07-424e-89cc-c0aaa012e311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:04.426748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-31a40cf3-ea07-424e-89cc-c0aaa012e311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:04.512871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:04.539552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a40cf3-ea07-424e-89cc-c0aaa012e311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:04.541033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a40cf3-ea07-424e-89cc-c0aaa012e311 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:04.560299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 672/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:07.288138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6956df5-4e59-49d3-b89c-acfff628b0f3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:07.288721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6956df5-4e59-49d3-b89c-acfff628b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:07.288721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6956df5-4e59-49d3-b89c-acfff628b0f3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:07.290061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 666/1338] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:07.296496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8fb24-8c48-4107-87b9-2d0e85613b6a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:07.297033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8fb24-8c48-4107-87b9-2d0e85613b6a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:07.297176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8fb24-8c48-4107-87b9-2d0e85613b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:07.368928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-caa8fb24-8c48-4107-87b9-2d0e85613b6a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:07.370147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-caa8fb24-8c48-4107-87b9-2d0e85613b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:07.474703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 673/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:07.759911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6956df5-4e59-49d3-b89c-acfff628b0f3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:07.761541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d6956df5-4e59-49d3-b89c-acfff628b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:07.848933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:07.878968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6956df5-4e59-49d3-b89c-acfff628b0f3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:07.956279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b88c07-ec0e-4e37-8647-973dc802d200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:07.956800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b88c07-ec0e-4e37-8647-973dc802d200 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:07.957081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b88c07-ec0e-4e37-8647-973dc802d200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:07.957348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b88c07-ec0e-4e37-8647-973dc802d200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:07.958970 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15b88c07-ec0e-4e37-8647-973dc802d200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:08.069761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b88c07-ec0e-4e37-8647-973dc802d200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:08.073046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b88c07-ec0e-4e37-8647-973dc802d200 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:08.090940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 667/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:12.459245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d0a24-c23b-43ff-a11a-47241cab7010 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:12.460242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d0a24-c23b-43ff-a11a-47241cab7010 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:12.460242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d0a24-c23b-43ff-a11a-47241cab7010 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:12.461648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 674/1341] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:12.467807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0ffe-ebab-44fb-b7ad-adcaa99e7f72 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:12.468350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0ffe-ebab-44fb-b7ad-adcaa99e7f72 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:12.468559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0ffe-ebab-44fb-b7ad-adcaa99e7f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:12.474252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:12.545753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-afda0ffe-ebab-44fb-b7ad-adcaa99e7f72 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:12.547132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-afda0ffe-ebab-44fb-b7ad-adcaa99e7f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:12.665884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 668/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:12.974030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d0a24-c23b-43ff-a11a-47241cab7010 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:12.975766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4f4d0a24-c23b-43ff-a11a-47241cab7010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:13.040490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:13.112536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d0a24-c23b-43ff-a11a-47241cab7010 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:13.201418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12629-3ea9-4e47-9f19-b566e7a64494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:13.202032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12629-3ea9-4e47-9f19-b566e7a64494 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:13.202382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12629-3ea9-4e47-9f19-b566e7a64494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:13.203742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12629-3ea9-4e47-9f19-b566e7a64494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:13.204262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1fd12629-3ea9-4e47-9f19-b566e7a64494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:13.307852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:13.325872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12629-3ea9-4e47-9f19-b566e7a64494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:13.327307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12629-3ea9-4e47-9f19-b566e7a64494 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:13.346680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 675/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:16.536076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4d86-9d55-4e69-b2d9-e5e2eb0ec4a6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:16.536654 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4d86-9d55-4e69-b2d9-e5e2eb0ec4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:16.537100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4d86-9d55-4e69-b2d9-e5e2eb0ec4a6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:16.539090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 669/1344] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:16.545349 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f280130-c5de-4ac5-9069-437210236091 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:16.545877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f280130-c5de-4ac5-9069-437210236091 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:16.545877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f280130-c5de-4ac5-9069-437210236091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:16.618909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3f280130-c5de-4ac5-9069-437210236091 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:16.620662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3f280130-c5de-4ac5-9069-437210236091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:16.731954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 676/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:11:17.024623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af4d86-9d55-4e69-b2d9-e5e2eb0ec4a6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:17.026241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e6af4d86-9d55-4e69-b2d9-e5e2eb0ec4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:17.125583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:17.151216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af4d86-9d55-4e69-b2d9-e5e2eb0ec4a6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:17.239291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64443e-c30e-4aa1-bc17-d448124eb6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:17.239928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64443e-c30e-4aa1-bc17-d448124eb6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:17.240199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64443e-c30e-4aa1-bc17-d448124eb6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:17.240506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64443e-c30e-4aa1-bc17-d448124eb6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:17.242293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d64443e-c30e-4aa1-bc17-d448124eb6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:17.380633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64443e-c30e-4aa1-bc17-d448124eb6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:17.382099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64443e-c30e-4aa1-bc17-d448124eb6a9 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:17.410720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 670/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:21.762984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aaf3a-6ab3-42cf-a474-46449298c74c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:21.763522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aaf3a-6ab3-42cf-a474-46449298c74c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:21.763638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aaf3a-6ab3-42cf-a474-46449298c74c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:21.767959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 677/1347] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:21.770897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d562-9547-427a-9f15-242b0b5b7c9f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:21.771378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d562-9547-427a-9f15-242b0b5b7c9f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:21.771613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d562-9547-427a-9f15-242b0b5b7c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:21.791115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:21.867673 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1cd3d562-9547-427a-9f15-242b0b5b7c9f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:21.870670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1cd3d562-9547-427a-9f15-242b0b5b7c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:22.064697 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 671/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:22.372424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aaf3a-6ab3-42cf-a474-46449298c74c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:22.373973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c37aaf3a-6ab3-42cf-a474-46449298c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:22.470415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:22.524317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aaf3a-6ab3-42cf-a474-46449298c74c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:22.614196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30021-c5e2-40f2-8134-51636a57a6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:22.614796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30021-c5e2-40f2-8134-51636a57a6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:22.615057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30021-c5e2-40f2-8134-51636a57a6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:22.615331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30021-c5e2-40f2-8134-51636a57a6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:22.617210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7cb30021-c5e2-40f2-8134-51636a57a6f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:22.741182 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:22.745988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb30021-c5e2-40f2-8134-51636a57a6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:22.748554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb30021-c5e2-40f2-8134-51636a57a6f0 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:22.780172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 678/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:28.712135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c06b1b-f0ac-4d7c-9b5a-8da7e016ed70 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:28.715606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c06b1b-f0ac-4d7c-9b5a-8da7e016ed70 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:28.716199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c06b1b-f0ac-4d7c-9b5a-8da7e016ed70 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:28.718616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 672/1350] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:11:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 12:11:28.724460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4a327-3a82-41b5-8230-7cc2b2d6456f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:28.725498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4a327-3a82-41b5-8230-7cc2b2d6456f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:28.731738 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4a327-3a82-41b5-8230-7cc2b2d6456f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:28.826760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-71a4a327-3a82-41b5-8230-7cc2b2d6456f None None] MFA Rules not processed for user `81919eaf832b4025a2118feb4e7fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:28.828311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-71a4a327-3a82-41b5-8230-7cc2b2d6456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:29.009258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 679/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:11:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:32.061823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=59 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:33.655248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fadc4b-07a5-4a0c-b79f-9fe1f07f7395 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:33.656507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fadc4b-07a5-4a0c-b79f-9fe1f07f7395 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:33.658845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fadc4b-07a5-4a0c-b79f-9fe1f07f7395 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:33.660599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 673/1352] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:11:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:33.667243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8af01c-08a8-4032-bf66-1960e92fa180 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:33.667997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8af01c-08a8-4032-bf66-1960e92fa180 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:33.667997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8af01c-08a8-4032-bf66-1960e92fa180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:33.739422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:33.768797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-2e8af01c-08a8-4032-bf66-1960e92fa180 None None] MFA Rules not processed for user `81919eaf832b4025a2118feb4e7fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:33.770024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2e8af01c-08a8-4032-bf66-1960e92fa180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:33.902730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 680/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:11:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:11:35.346226 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014196e-41b0-4e35-9966-1ad9883cc1e6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:35.346981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014196e-41b0-4e35-9966-1ad9883cc1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:35.346981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014196e-41b0-4e35-9966-1ad9883cc1e6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:35.348309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 674/1354] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:35.356748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe4e4-0691-4a48-ad43-00a140850604 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:35.357457 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe4e4-0691-4a48-ad43-00a140850604 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:35.357606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe4e4-0691-4a48-ad43-00a140850604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:35.451036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-018fe4e4-0691-4a48-ad43-00a140850604 None None] MFA Rules not processed for user `81919eaf832b4025a2118feb4e7fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:35.452275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-018fe4e4-0691-4a48-ad43-00a140850604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:35.502325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:35.585304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 681/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:11:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:39.634817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ebdfa-fc14-4170-abf2-af068778aa39 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:39.635434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ebdfa-fc14-4170-abf2-af068778aa39 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:39.635434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ebdfa-fc14-4170-abf2-af068778aa39 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:39.636864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 675/1356] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:39.646413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd8b0b-16d5-4d53-b8a0-c8a76191077a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:39.646413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd8b0b-16d5-4d53-b8a0-c8a76191077a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:39.646413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd8b0b-16d5-4d53-b8a0-c8a76191077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:39.745902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c7bd8b0b-16d5-4d53-b8a0-c8a76191077a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:39.747339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c7bd8b0b-16d5-4d53-b8a0-c8a76191077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:39.880907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 682/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:11:40.187525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c9397-8190-4007-a00a-0c59ed9196e2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:40.188537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c9397-8190-4007-a00a-0c59ed9196e2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:40.189330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c9397-8190-4007-a00a-0c59ed9196e2 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:40.192284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 676/1358] 10.222.0.18 () {54 vars in 962 bytes} [Thu Sep 1 12:11:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:40.202574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058eefc-ce62-4888-aa34-a36cc2b99c4d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:40.203722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058eefc-ce62-4888-aa34-a36cc2b99c4d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:40.204524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058eefc-ce62-4888-aa34-a36cc2b99c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:40.234888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:40.356648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c058eefc-ce62-4888-aa34-a36cc2b99c4d None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:40.358693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c058eefc-ce62-4888-aa34-a36cc2b99c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:40.563014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 683/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Sep 1 12:11:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:11:40.572870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c9397-8190-4007-a00a-0c59ed9196e2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:40.574597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d54c9397-8190-4007-a00a-0c59ed9196e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:40.743219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c9397-8190-4007-a00a-0c59ed9196e2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:40.826492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:40.876294 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648c1a4-bfa3-4e4b-8423-8ae476d88d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:40.877411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648c1a4-bfa3-4e4b-8423-8ae476d88d10 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:40.877938 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648c1a4-bfa3-4e4b-8423-8ae476d88d10 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:40.878431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648c1a4-bfa3-4e4b-8423-8ae476d88d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:40.880412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b648c1a4-bfa3-4e4b-8423-8ae476d88d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:40.989973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648c1a4-bfa3-4e4b-8423-8ae476d88d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:40.991961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648c1a4-bfa3-4e4b-8423-8ae476d88d10 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:41.016511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 677/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:43.424166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bee93-305d-4d68-9e96-5774143a198e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:43.424915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bee93-305d-4d68-9e96-5774143a198e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:43.424915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bee93-305d-4d68-9e96-5774143a198e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:43.426326 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 684/1361] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:43.432159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353adaa-e8b9-4e3a-8d12-9c948cee48b6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:43.432829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353adaa-e8b9-4e3a-8d12-9c948cee48b6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:43.432829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353adaa-e8b9-4e3a-8d12-9c948cee48b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:43.522886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3353adaa-e8b9-4e3a-8d12-9c948cee48b6 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:43.524311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3353adaa-e8b9-4e3a-8d12-9c948cee48b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:43.577969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:43.697935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 678/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:44.011690 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bee93-305d-4d68-9e96-5774143a198e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:44.013352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bb2bee93-305d-4d68-9e96-5774143a198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:44.115908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:44.220391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bee93-305d-4d68-9e96-5774143a198e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:44.393186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e6b9c-93c2-4f10-acab-82c4459af8d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:44.394250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e6b9c-93c2-4f10-acab-82c4459af8d9 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:44.394724 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e6b9c-93c2-4f10-acab-82c4459af8d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:44.395152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e6b9c-93c2-4f10-acab-82c4459af8d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:44.397640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-977e6b9c-93c2-4f10-acab-82c4459af8d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:44.434786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:44.529111 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e6b9c-93c2-4f10-acab-82c4459af8d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:44.531644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e6b9c-93c2-4f10-acab-82c4459af8d9 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:44.561754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 685/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:47.131797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb83a7-fff9-4f25-8132-fbf7923438a1 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:47.132502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb83a7-fff9-4f25-8132-fbf7923438a1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:47.132502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb83a7-fff9-4f25-8132-fbf7923438a1 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:47.134764 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 679/1364] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:47.140610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f9c2b-5f84-4edc-b6cb-98741c7a8c9f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:47.141180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f9c2b-5f84-4edc-b6cb-98741c7a8c9f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:47.141440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f9c2b-5f84-4edc-b6cb-98741c7a8c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:47.223341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c49f9c2b-5f84-4edc-b6cb-98741c7a8c9f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:47.225081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c49f9c2b-5f84-4edc-b6cb-98741c7a8c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:47.340429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:47.344600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 686/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:47.652127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2eaed-0a8c-47ae-b87a-a2b786aa8319 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:47.652484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2eaed-0a8c-47ae-b87a-a2b786aa8319 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:47.652764 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2eaed-0a8c-47ae-b87a-a2b786aa8319 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:47.654386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 680/1366] 10.222.0.18 () {54 vars in 962 bytes} [Thu Sep 1 12:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:47.661297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381f810-59d0-4ea1-9f57-1867f4d05c7f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:47.661597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381f810-59d0-4ea1-9f57-1867f4d05c7f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:47.661859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381f810-59d0-4ea1-9f57-1867f4d05c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:47.757880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-2381f810-59d0-4ea1-9f57-1867f4d05c7f None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:47.759467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2381f810-59d0-4ea1-9f57-1867f4d05c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:47.900488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 687/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Sep 1 12:11:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:11:47.903880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2eaed-0a8c-47ae-b87a-a2b786aa8319 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:47.905679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-14d2eaed-0a8c-47ae-b87a-a2b786aa8319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:48.104466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2eaed-0a8c-47ae-b87a-a2b786aa8319 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:48.131538 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:48.242884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfefb8a-6f6d-4f0b-896a-e6d3632241e5 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:48.243436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfefb8a-6f6d-4f0b-896a-e6d3632241e5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:48.243436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfefb8a-6f6d-4f0b-896a-e6d3632241e5 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:48.244935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 688/1368] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 12:11:48.250644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b15ee-fcfd-43ce-a735-1a513a19f85c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:48.250644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b15ee-fcfd-43ce-a735-1a513a19f85c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:48.250644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b15ee-fcfd-43ce-a735-1a513a19f85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:48.278170 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb25b3-9fd5-4dea-bed0-7009e06126cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:48.278987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb25b3-9fd5-4dea-bed0-7009e06126cd service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:48.279142 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb25b3-9fd5-4dea-bed0-7009e06126cd service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:48.279405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb25b3-9fd5-4dea-bed0-7009e06126cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:48.281276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c7cb25b3-9fd5-4dea-bed0-7009e06126cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:48.353492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:48.371307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0b2b15ee-fcfd-43ce-a735-1a513a19f85c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:48.371307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0b2b15ee-fcfd-43ce-a735-1a513a19f85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:48.418544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb25b3-9fd5-4dea-bed0-7009e06126cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:48.421148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb25b3-9fd5-4dea-bed0-7009e06126cd service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:48.452765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 681/1369] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:48.514739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 689/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:11:49.084061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc84625-a0eb-458b-8efa-e847f07dda44 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:49.084413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc84625-a0eb-458b-8efa-e847f07dda44 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:49.084654 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc84625-a0eb-458b-8efa-e847f07dda44 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:49.086161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 682/1371] 10.222.0.18 () {54 vars in 964 bytes} [Thu Sep 1 12:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:49.091044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25da4-76ec-4a29-92fc-9bee74bc633d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:49.091337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25da4-76ec-4a29-92fc-9bee74bc633d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:49.091615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25da4-76ec-4a29-92fc-9bee74bc633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:49.184290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5dd25da4-76ec-4a29-92fc-9bee74bc633d None None] MFA Rules not processed for user `afb45915b43b471a84fbd363fade7241`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:49.185958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5dd25da4-76ec-4a29-92fc-9bee74bc633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:49.268135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:49.276640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 690/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Sep 1 12:11:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:49.285954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc84625-a0eb-458b-8efa-e847f07dda44 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:49.286622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ebc84625-a0eb-458b-8efa-e847f07dda44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:49.320568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:49.441961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc84625-a0eb-458b-8efa-e847f07dda44 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:49.629312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69a1c6-691b-4f66-a588-714ae807b1d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:49.630901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69a1c6-691b-4f66-a588-714ae807b1d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:49.631804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69a1c6-691b-4f66-a588-714ae807b1d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:49.632588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69a1c6-691b-4f66-a588-714ae807b1d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:49.636348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cb69a1c6-691b-4f66-a588-714ae807b1d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:49.863107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:49.921049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69a1c6-691b-4f66-a588-714ae807b1d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:49.922498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69a1c6-691b-4f66-a588-714ae807b1d8 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:49.941889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 683/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:50.684346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216eae0-8d70-4a0e-a0e3-76c4c0dab797 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:50.685141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216eae0-8d70-4a0e-a0e3-76c4c0dab797 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:50.685289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216eae0-8d70-4a0e-a0e3-76c4c0dab797 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:50.687193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 691/1374] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:50.693545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b3b0b-f69c-4510-89a6-3d3f0ecf3d3d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:50.694481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b3b0b-f69c-4510-89a6-3d3f0ecf3d3d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:50.694481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b3b0b-f69c-4510-89a6-3d3f0ecf3d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:50.786959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c14b3b0b-f69c-4510-89a6-3d3f0ecf3d3d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:50.788198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c14b3b0b-f69c-4510-89a6-3d3f0ecf3d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:50.892834 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 684/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:11:51.185245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216eae0-8d70-4a0e-a0e3-76c4c0dab797 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:51.186868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a216eae0-8d70-4a0e-a0e3-76c4c0dab797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:51.355866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216eae0-8d70-4a0e-a0e3-76c4c0dab797 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:51.437945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:51.497253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a278735-b169-4156-9bcc-5ac607194b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:51.498134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278735-b169-4156-9bcc-5ac607194b34 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:51.498756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278735-b169-4156-9bcc-5ac607194b34 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:51.499136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278735-b169-4156-9bcc-5ac607194b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:51.501580 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1a278735-b169-4156-9bcc-5ac607194b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:51.610575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a278735-b169-4156-9bcc-5ac607194b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:51.610575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a278735-b169-4156-9bcc-5ac607194b34 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:51.627453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 692/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:53.765134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549d5f-c067-4320-89f7-a0b1c23c428b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:53.765650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549d5f-c067-4320-89f7-a0b1c23c428b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:53.765835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549d5f-c067-4320-89f7-a0b1c23c428b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:53.767597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 685/1377] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:53.773320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5be55c-7804-4974-99be-eea21a2941bb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:53.774050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5be55c-7804-4974-99be-eea21a2941bb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:53.774335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5be55c-7804-4974-99be-eea21a2941bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:53.847531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-cd5be55c-7804-4974-99be-eea21a2941bb None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:53.848817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cd5be55c-7804-4974-99be-eea21a2941bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:53.881190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:53.997316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 693/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:54.385781 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549d5f-c067-4320-89f7-a0b1c23c428b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:54.387299 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e0549d5f-c067-4320-89f7-a0b1c23c428b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:54.432794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:54.576687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549d5f-c067-4320-89f7-a0b1c23c428b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:54.722432 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:54.729008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441adffe-fa9b-457e-b88c-4b032a5a134e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:54.729731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441adffe-fa9b-457e-b88c-4b032a5a134e service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:54.730012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441adffe-fa9b-457e-b88c-4b032a5a134e service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:54.730480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441adffe-fa9b-457e-b88c-4b032a5a134e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:54.732241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-441adffe-fa9b-457e-b88c-4b032a5a134e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:54.850742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441adffe-fa9b-457e-b88c-4b032a5a134e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:54.853091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441adffe-fa9b-457e-b88c-4b032a5a134e service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:54.873217 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 686/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:11:57.143436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89c0e-1e1e-4384-a40f-9b7658e872e9 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:57.144032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89c0e-1e1e-4384-a40f-9b7658e872e9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:57.144506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89c0e-1e1e-4384-a40f-9b7658e872e9 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:57.146369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 694/1380] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:11:57.152269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923530-5e20-46eb-b8c3-059e9d5400f2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:57.152910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923530-5e20-46eb-b8c3-059e9d5400f2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:57.152910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923530-5e20-46eb-b8c3-059e9d5400f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:57.229225 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-76923530-5e20-46eb-b8c3-059e9d5400f2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:11:57.230431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-76923530-5e20-46eb-b8c3-059e9d5400f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:57.320011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:57.372807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 687/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:11:57.695146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb89c0e-1e1e-4384-a40f-9b7658e872e9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:11:57.698517 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cfb89c0e-1e1e-4384-a40f-9b7658e872e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:57.884948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb89c0e-1e1e-4384-a40f-9b7658e872e9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:11:57.899819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:11:58.007021 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6c7b2-7714-4a94-8ac9-ce5e37e19df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:11:58.007722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c7b2-7714-4a94-8ac9-ce5e37e19df8 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:11:58.008066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c7b2-7714-4a94-8ac9-ce5e37e19df8 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:11:58.008447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c7b2-7714-4a94-8ac9-ce5e37e19df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:11:58.010342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-09b6c7b2-7714-4a94-8ac9-ce5e37e19df8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:11:58.118175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6c7b2-7714-4a94-8ac9-ce5e37e19df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:11:58.119725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6c7b2-7714-4a94-8ac9-ce5e37e19df8 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:11:58.140111 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 695/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:00.265002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d560f7-9c78-477a-8a15-63193bac52dd None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:00.265575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d560f7-9c78-477a-8a15-63193bac52dd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:00.265575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d560f7-9c78-477a-8a15-63193bac52dd None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:00.267341 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 688/1383] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:00.272640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7822-bcc6-4bcb-a54b-8dc3e824373e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:00.273116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7822-bcc6-4bcb-a54b-8dc3e824373e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:00.273212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7822-bcc6-4bcb-a54b-8dc3e824373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:00.298517 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:00.350149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-141d7822-bcc6-4bcb-a54b-8dc3e824373e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:00.351442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-141d7822-bcc6-4bcb-a54b-8dc3e824373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:00.475987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 696/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:00.776074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d560f7-9c78-477a-8a15-63193bac52dd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:00.777804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e1d560f7-9c78-477a-8a15-63193bac52dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:00.977441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d560f7-9c78-477a-8a15-63193bac52dd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:01.031628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:01.094689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5c400-5836-4fae-80fc-766866704464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:01.095311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5c400-5836-4fae-80fc-766866704464 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:01.095595 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5c400-5836-4fae-80fc-766866704464 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:01.095877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5c400-5836-4fae-80fc-766866704464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:01.097731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0ea5c400-5836-4fae-80fc-766866704464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:01.201406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5c400-5836-4fae-80fc-766866704464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:01.203908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5c400-5836-4fae-80fc-766866704464 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:01.226533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 689/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:03.185580 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612562-cad8-494b-bd08-7475649a23fc None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:03.186131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612562-cad8-494b-bd08-7475649a23fc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:03.186131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612562-cad8-494b-bd08-7475649a23fc None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:03.187488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 697/1386] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:03.193183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eee39-03c7-4877-ae28-98bd5d73d1a1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:03.194304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eee39-03c7-4877-ae28-98bd5d73d1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:03.194304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eee39-03c7-4877-ae28-98bd5d73d1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:03.292257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3d4eee39-03c7-4877-ae28-98bd5d73d1a1 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:03.294031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3d4eee39-03c7-4877-ae28-98bd5d73d1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:03.308985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:03.416658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 690/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:03.719116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78612562-cad8-494b-bd08-7475649a23fc None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:03.721275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-78612562-cad8-494b-bd08-7475649a23fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:03.839700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:03.908825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78612562-cad8-494b-bd08-7475649a23fc None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:04.054019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06c43e-ce1c-4b59-9121-a8f76ca10aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:04.055505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06c43e-ce1c-4b59-9121-a8f76ca10aef service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:04.055938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06c43e-ce1c-4b59-9121-a8f76ca10aef service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:04.056394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06c43e-ce1c-4b59-9121-a8f76ca10aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:04.058708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7f06c43e-ce1c-4b59-9121-a8f76ca10aef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:04.150331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:04.181799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06c43e-ce1c-4b59-9121-a8f76ca10aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:04.183461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06c43e-ce1c-4b59-9121-a8f76ca10aef service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:04.203268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 698/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:06.411296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517c6f3-34a9-483d-8783-16aff96ffb5b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:06.411896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517c6f3-34a9-483d-8783-16aff96ffb5b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:06.412380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517c6f3-34a9-483d-8783-16aff96ffb5b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:06.415698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 691/1389] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:12:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 12:12:06.425649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a0e3-c8df-47db-be85-8609908d80ad None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:06.426343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a0e3-c8df-47db-be85-8609908d80ad None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:06.426782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a0e3-c8df-47db-be85-8609908d80ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:06.544663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-03f2a0e3-c8df-47db-be85-8609908d80ad None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:06.546766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-03f2a0e3-c8df-47db-be85-8609908d80ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:06.672261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 699/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:06.982869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517c6f3-34a9-483d-8783-16aff96ffb5b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:06.985920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4517c6f3-34a9-483d-8783-16aff96ffb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:07.188737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:07.196474 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517c6f3-34a9-483d-8783-16aff96ffb5b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:07.329785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f3096-dc13-41fe-a119-c69e2508fe99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:07.330301 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f3096-dc13-41fe-a119-c69e2508fe99 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:07.330576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f3096-dc13-41fe-a119-c69e2508fe99 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:07.330844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f3096-dc13-41fe-a119-c69e2508fe99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:07.332743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cf1f3096-dc13-41fe-a119-c69e2508fe99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:07.437135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f3096-dc13-41fe-a119-c69e2508fe99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:07.438744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f3096-dc13-41fe-a119-c69e2508fe99 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:07.454155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:07.459322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 692/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:07.623496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac15b5f-574e-45ed-ae91-fa973c32c648 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:07.624097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac15b5f-574e-45ed-ae91-fa973c32c648 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:07.624097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac15b5f-574e-45ed-ae91-fa973c32c648 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:07.625727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 700/1392] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:07.631587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc861-ed20-4bf5-addc-c9f3ec0c21e2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:07.631873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc861-ed20-4bf5-addc-c9f3ec0c21e2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:07.632173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc861-ed20-4bf5-addc-c9f3ec0c21e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:07.717700 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-433dc861-ed20-4bf5-addc-c9f3ec0c21e2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:07.725296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-433dc861-ed20-4bf5-addc-c9f3ec0c21e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:07.836977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 693/1393] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:08.172314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a2aa-c7bf-4427-a217-d51f7d5d7916 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:08.172724 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a2aa-c7bf-4427-a217-d51f7d5d7916 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:08.173151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a2aa-c7bf-4427-a217-d51f7d5d7916 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:08.174781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 701/1394] 10.222.0.18 () {54 vars in 967 bytes} [Thu Sep 1 12:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 12:12:08.182593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93ef6a-bb90-4abd-ae8c-64f0e57be210 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:08.182965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93ef6a-bb90-4abd-ae8c-64f0e57be210 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:08.183512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93ef6a-bb90-4abd-ae8c-64f0e57be210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:08.281161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8f93ef6a-bb90-4abd-ae8c-64f0e57be210 None None] MFA Rules not processed for user `76b84587baf0432c800a6278d7095cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:08.282428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8f93ef6a-bb90-4abd-ae8c-64f0e57be210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:08.304034 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:08.370425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 694/1395] 10.222.0.18 () {58 vars in 1064 bytes} [Thu Sep 1 12:12:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:08.378217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a2aa-c7bf-4427-a217-d51f7d5d7916 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:08.379759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-be14a2aa-c7bf-4427-a217-d51f7d5d7916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:08.424709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:08.507535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a2aa-c7bf-4427-a217-d51f7d5d7916 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:08.588016 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268589f-6e86-4256-8cdc-51e9c2884a51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b84587baf0432c800a6278d7095cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:08.588687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268589f-6e86-4256-8cdc-51e9c2884a51 service glance] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:08.588968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268589f-6e86-4256-8cdc-51e9c2884a51 service glance] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:08.589244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268589f-6e86-4256-8cdc-51e9c2884a51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:08.590894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4268589f-6e86-4256-8cdc-51e9c2884a51 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:08.688944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:08.717375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268589f-6e86-4256-8cdc-51e9c2884a51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:08.718804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268589f-6e86-4256-8cdc-51e9c2884a51 service glance] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:08.738252 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 702/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:09.750818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececc05f-d139-456d-9cfc-f084b9dd58d9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:09.783480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececc05f-d139-456d-9cfc-f084b9dd58d9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:09.783480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececc05f-d139-456d-9cfc-f084b9dd58d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:09.831596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ececc05f-d139-456d-9cfc-f084b9dd58d9 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:09.844612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ececc05f-d139-456d-9cfc-f084b9dd58d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:09.932110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 695/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:12:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:09.982118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a9a5-b00f-42ac-be99-1775797c4e56 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:09.982830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a9a5-b00f-42ac-be99-1775797c4e56 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:09.982830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a9a5-b00f-42ac-be99-1775797c4e56 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:09.984144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 703/1398] 10.222.0.18 () {54 vars in 943 bytes} [Thu Sep 1 12:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:09.991267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e905a3-9bbe-4d5e-9d52-a5ec46d209b1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:09.991788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e905a3-9bbe-4d5e-9d52-a5ec46d209b1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:09.992260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e905a3-9bbe-4d5e-9d52-a5ec46d209b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:10.037210 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:10.080804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d8e905a3-9bbe-4d5e-9d52-a5ec46d209b1 None None] MFA Rules not processed for user `8a59a4732ec14a838be9c838dbeb7fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:10.082196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d8e905a3-9bbe-4d5e-9d52-a5ec46d209b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:10.215758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 696/1399] 10.222.0.18 () {58 vars in 1040 bytes} [Thu Sep 1 12:12:09 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:10.226121 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a9a5-b00f-42ac-be99-1775797c4e56 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:10.228259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5d50a9a5-b00f-42ac-be99-1775797c4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:10.383180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a9a5-b00f-42ac-be99-1775797c4e56 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:10.454594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:10.511145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40af765-8051-4908-8cd5-9ea2b13bd14e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:10.511775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40af765-8051-4908-8cd5-9ea2b13bd14e service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:10.512054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40af765-8051-4908-8cd5-9ea2b13bd14e service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:10.512365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40af765-8051-4908-8cd5-9ea2b13bd14e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:10.514083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c40af765-8051-4908-8cd5-9ea2b13bd14e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:10.637204 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40af765-8051-4908-8cd5-9ea2b13bd14e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:10.640194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40af765-8051-4908-8cd5-9ea2b13bd14e service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:10.656189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 704/1400] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:12:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 12:12:10.720464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351388fa-b2c5-47f6-a729-c2c70959e104 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:10.720806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351388fa-b2c5-47f6-a729-c2c70959e104 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:10.721134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351388fa-b2c5-47f6-a729-c2c70959e104 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:10.722704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 697/1401] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:10.728307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8d21-eb6c-4b50-be3a-c16d80a3cf4d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:10.728593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8d21-eb6c-4b50-be3a-c16d80a3cf4d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:10.728866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8d21-eb6c-4b50-be3a-c16d80a3cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:10.800565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-354f8d21-eb6c-4b50-be3a-c16d80a3cf4d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:10.801871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-354f8d21-eb6c-4b50-be3a-c16d80a3cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:10.847647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:10.936292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 705/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:11.258966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351388fa-b2c5-47f6-a729-c2c70959e104 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:11.260558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-351388fa-b2c5-47f6-a729-c2c70959e104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:11.368307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:11.447287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351388fa-b2c5-47f6-a729-c2c70959e104 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:11.604746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d155e-93a1-47d1-ba7b-6db740bedb57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:11.605269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d155e-93a1-47d1-ba7b-6db740bedb57 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:11.605549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d155e-93a1-47d1-ba7b-6db740bedb57 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:11.605823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d155e-93a1-47d1-ba7b-6db740bedb57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:11.607467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e52d155e-93a1-47d1-ba7b-6db740bedb57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:11.688582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:11.744749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d155e-93a1-47d1-ba7b-6db740bedb57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:11.748860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d155e-93a1-47d1-ba7b-6db740bedb57 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:11.772246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 698/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:12:14.099625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd6c8e-c54a-48c5-a82d-e3ead42f9afb None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:14.099625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd6c8e-c54a-48c5-a82d-e3ead42f9afb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:14.099625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd6c8e-c54a-48c5-a82d-e3ead42f9afb None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:14.103640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 706/1404] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:12:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:14.105817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00de4ac-db67-411c-97f1-c5b96d732c1b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:14.106350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00de4ac-db67-411c-97f1-c5b96d732c1b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:14.106350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00de4ac-db67-411c-97f1-c5b96d732c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:14.187436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a00de4ac-db67-411c-97f1-c5b96d732c1b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:14.188810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a00de4ac-db67-411c-97f1-c5b96d732c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:14.317443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 699/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:12:14.615068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd6c8e-c54a-48c5-a82d-e3ead42f9afb None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:14.616725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5dbd6c8e-c54a-48c5-a82d-e3ead42f9afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:14.867346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd6c8e-c54a-48c5-a82d-e3ead42f9afb None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:14.904777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:15.058474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8785a-6dc8-45b9-8ed6-154b3ff91bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:15.059448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8785a-6dc8-45b9-8ed6-154b3ff91bbc service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:15.059742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8785a-6dc8-45b9-8ed6-154b3ff91bbc service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:15.060127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8785a-6dc8-45b9-8ed6-154b3ff91bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:15.062348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-10b8785a-6dc8-45b9-8ed6-154b3ff91bbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:15.205210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8785a-6dc8-45b9-8ed6-154b3ff91bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:15.206874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8785a-6dc8-45b9-8ed6-154b3ff91bbc service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:15.228503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 707/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:12:17.387769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7712398-377b-470e-9362-87167fe085fa None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:17.388709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7712398-377b-470e-9362-87167fe085fa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:17.389053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7712398-377b-470e-9362-87167fe085fa None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:17.391096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 700/1407] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:17.396261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a99dc-934d-47fe-97b6-26a7e661e52f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:17.396829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a99dc-934d-47fe-97b6-26a7e661e52f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:17.396829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a99dc-934d-47fe-97b6-26a7e661e52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:17.437455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:17.480894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-198a99dc-934d-47fe-97b6-26a7e661e52f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:17.482492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-198a99dc-934d-47fe-97b6-26a7e661e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:17.620473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 708/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:17.917776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7712398-377b-470e-9362-87167fe085fa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:17.919566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f7712398-377b-470e-9362-87167fe085fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:17.967003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:18.113235 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7712398-377b-470e-9362-87167fe085fa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:18.249980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:18.257441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2702f63-16bd-4dd4-a191-4f2209be7b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:18.258094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702f63-16bd-4dd4-a191-4f2209be7b4d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:18.258375 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702f63-16bd-4dd4-a191-4f2209be7b4d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:18.258650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702f63-16bd-4dd4-a191-4f2209be7b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:18.260369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2702f63-16bd-4dd4-a191-4f2209be7b4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:18.406519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2702f63-16bd-4dd4-a191-4f2209be7b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:18.410102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2702f63-16bd-4dd4-a191-4f2209be7b4d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:18.455231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 701/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:27.617745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=52 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:28.443690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=48 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:34.954833 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67644a9b-9afe-4e69-a20f-81d0cec44e44 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:34.955401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67644a9b-9afe-4e69-a20f-81d0cec44e44 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:34.955401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67644a9b-9afe-4e69-a20f-81d0cec44e44 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:34.956698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 709/1410] 10.222.0.18 () {54 vars in 918 bytes} [Thu Sep 1 12:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:34.962712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c2c3c-1283-498b-9834-0d405836d895 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:34.963152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c2c3c-1283-498b-9834-0d405836d895 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:34.963290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c2c3c-1283-498b-9834-0d405836d895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:35.041080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fa2c2c3c-1283-498b-9834-0d405836d895 None None] MFA Rules not processed for user `81919eaf832b4025a2118feb4e7fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:35.042308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fa2c2c3c-1283-498b-9834-0d405836d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:35.150910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 702/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Sep 1 12:12:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:35.165411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091329b8-641f-4674-bed4-4dd84dd46250 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:35.165696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091329b8-641f-4674-bed4-4dd84dd46250 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:35.165977 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091329b8-641f-4674-bed4-4dd84dd46250 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:35.167306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 710/1412] 10.222.0.18 () {54 vars in 918 bytes} [Thu Sep 1 12:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:35.171934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198e377-25b1-4de7-a6a5-d3a8ec38add1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:35.172239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198e377-25b1-4de7-a6a5-d3a8ec38add1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:35.172511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198e377-25b1-4de7-a6a5-d3a8ec38add1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:35.247073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:35.249700 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0198e377-25b1-4de7-a6a5-d3a8ec38add1 None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:35.250930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0198e377-25b1-4de7-a6a5-d3a8ec38add1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:35.369624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 703/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Sep 1 12:12:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:37.779480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832ddf3-e6fd-45cd-8d19-1882c243f2b1 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:37.780066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832ddf3-e6fd-45cd-8d19-1882c243f2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:37.780186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832ddf3-e6fd-45cd-8d19-1882c243f2b1 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:37.781540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:37.787521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ea82-9e5a-42c5-95c4-b13064da8409 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:37.788583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ea82-9e5a-42c5-95c4-b13064da8409 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:37.788583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ea82-9e5a-42c5-95c4-b13064da8409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:37.857337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8293ea82-9e5a-42c5-95c4-b13064da8409 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:37.858567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8293ea82-9e5a-42c5-95c4-b13064da8409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:37.914071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:37.956714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:38.256079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832ddf3-e6fd-45cd-8d19-1882c243f2b1 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:38.257656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c832ddf3-e6fd-45cd-8d19-1882c243f2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:38.411874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832ddf3-e6fd-45cd-8d19-1882c243f2b1 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:38.487511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:38.530197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d1390-6d6f-4ba3-a2b6-f3f9d815e71f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:38.530759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1390-6d6f-4ba3-a2b6-f3f9d815e71f service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:38.531040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1390-6d6f-4ba3-a2b6-f3f9d815e71f service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:38.531314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1390-6d6f-4ba3-a2b6-f3f9d815e71f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:38.532956 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3d7d1390-6d6f-4ba3-a2b6-f3f9d815e71f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:38.629616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d1390-6d6f-4ba3-a2b6-f3f9d815e71f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:38.631264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d1390-6d6f-4ba3-a2b6-f3f9d815e71f service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:38.652984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 712/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:39.561026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b202bb-b194-4d5c-b84e-4e7681e54ee0 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:39.561621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b202bb-b194-4d5c-b84e-4e7681e54ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:39.561621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b202bb-b194-4d5c-b84e-4e7681e54ee0 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:39.562928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:39.568588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112245e7-c42d-40e7-bf01-aa2280c38e32 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:39.569910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112245e7-c42d-40e7-bf01-aa2280c38e32 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:39.570138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112245e7-c42d-40e7-bf01-aa2280c38e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:39.650182 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-112245e7-c42d-40e7-bf01-aa2280c38e32 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:39.651241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-112245e7-c42d-40e7-bf01-aa2280c38e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:39.680386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:39.754177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:39.904809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b202bb-b194-4d5c-b84e-4e7681e54ee0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:39.906271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-67b202bb-b194-4d5c-b84e-4e7681e54ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:40.065565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b202bb-b194-4d5c-b84e-4e7681e54ee0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:40.105799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:40.179281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ad7bd-4a34-443b-a0d2-4a7b7a5215ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:40.179795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ad7bd-4a34-443b-a0d2-4a7b7a5215ea service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:40.180069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ad7bd-4a34-443b-a0d2-4a7b7a5215ea service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:40.180384 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ad7bd-4a34-443b-a0d2-4a7b7a5215ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:40.182013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-429ad7bd-4a34-443b-a0d2-4a7b7a5215ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:40.271630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ad7bd-4a34-443b-a0d2-4a7b7a5215ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:40.273751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ad7bd-4a34-443b-a0d2-4a7b7a5215ea service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:40.294593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 706/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:41.199591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c23e-2d0d-4cdc-a3ca-c334dd4ec903 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:41.200191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c23e-2d0d-4cdc-a3ca-c334dd4ec903 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:41.200191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c23e-2d0d-4cdc-a3ca-c334dd4ec903 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:41.201518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:41.206665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e369c-1fe5-4501-bb0d-b03f2b022db2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:41.207082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e369c-1fe5-4501-bb0d-b03f2b022db2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:41.207217 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e369c-1fe5-4501-bb0d-b03f2b022db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:41.263622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:41.285540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d28e369c-1fe5-4501-bb0d-b03f2b022db2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:41.286770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d28e369c-1fe5-4501-bb0d-b03f2b022db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:41.385968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:41.540030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8c23e-2d0d-4cdc-a3ca-c334dd4ec903 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:41.541532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-47b8c23e-2d0d-4cdc-a3ca-c334dd4ec903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:41.691665 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8c23e-2d0d-4cdc-a3ca-c334dd4ec903 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:41.704402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:41.808729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a95b0-166f-4b51-aae0-a8c05e3d0a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:41.809167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a95b0-166f-4b51-aae0-a8c05e3d0a04 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:41.809445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a95b0-166f-4b51-aae0-a8c05e3d0a04 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:41.810139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a95b0-166f-4b51-aae0-a8c05e3d0a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:41.811337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3d2a95b0-166f-4b51-aae0-a8c05e3d0a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:41.902792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a95b0-166f-4b51-aae0-a8c05e3d0a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:41.904435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a95b0-166f-4b51-aae0-a8c05e3d0a04 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:41.922989 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 715/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:42.802025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e282-ff0a-4b41-b462-3bc569cabef9 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:42.802594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e282-ff0a-4b41-b462-3bc569cabef9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:42.802594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e282-ff0a-4b41-b462-3bc569cabef9 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:42.804485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:42.809672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd21fd0-c683-4e57-8062-793d98794ca4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:42.810104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd21fd0-c683-4e57-8062-793d98794ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:42.810227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd21fd0-c683-4e57-8062-793d98794ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:42.830579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:42.887898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-cbd21fd0-c683-4e57-8062-793d98794ca4 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:42.889429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cbd21fd0-c683-4e57-8062-793d98794ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:42.985203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:43.151788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4e282-ff0a-4b41-b462-3bc569cabef9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:43.153360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a7a4e282-ff0a-4b41-b462-3bc569cabef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:43.265290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:43.302868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4e282-ff0a-4b41-b462-3bc569cabef9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:43.418719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae636581-8049-4773-8292-630c9b20922c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:43.419335 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae636581-8049-4773-8292-630c9b20922c service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:43.419610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae636581-8049-4773-8292-630c9b20922c service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:43.419880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae636581-8049-4773-8292-630c9b20922c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:43.421554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ae636581-8049-4773-8292-630c9b20922c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:43.513530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:43.527533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae636581-8049-4773-8292-630c9b20922c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:43.529087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae636581-8049-4773-8292-630c9b20922c service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:43.548761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 709/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:44.431380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927de4a3-0676-4f20-83b1-1d009559f92f None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:44.431961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927de4a3-0676-4f20-83b1-1d009559f92f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:44.431961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927de4a3-0676-4f20-83b1-1d009559f92f None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:44.433351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:44.438688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a91dbb-3fec-4d54-bd3d-fe2827f84852 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:44.439126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a91dbb-3fec-4d54-bd3d-fe2827f84852 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:44.439228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a91dbb-3fec-4d54-bd3d-fe2827f84852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:44.515931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-52a91dbb-3fec-4d54-bd3d-fe2827f84852 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:44.517317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52a91dbb-3fec-4d54-bd3d-fe2827f84852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:44.617728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:44.768032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927de4a3-0676-4f20-83b1-1d009559f92f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:44.769602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-927de4a3-0676-4f20-83b1-1d009559f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:44.855170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:44.919160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927de4a3-0676-4f20-83b1-1d009559f92f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:45.032926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bc665-a54f-4b39-9ebc-0750cf05bd33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:45.033462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bc665-a54f-4b39-9ebc-0750cf05bd33 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:45.033742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bc665-a54f-4b39-9ebc-0750cf05bd33 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:45.034012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bc665-a54f-4b39-9ebc-0750cf05bd33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:45.035613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ab0bc665-a54f-4b39-9ebc-0750cf05bd33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:45.086518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:45.128555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bc665-a54f-4b39-9ebc-0750cf05bd33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:45.130197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bc665-a54f-4b39-9ebc-0750cf05bd33 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:45.149405 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 718/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:46.028910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39072304-aa8a-4c7e-b10b-f1d5a03747cb None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:46.029445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39072304-aa8a-4c7e-b10b-f1d5a03747cb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:46.029445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39072304-aa8a-4c7e-b10b-f1d5a03747cb None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:46.030720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:46.035813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec39a08-797d-45da-a022-fbca70378206 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:46.036243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec39a08-797d-45da-a022-fbca70378206 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:46.036464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec39a08-797d-45da-a022-fbca70378206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:46.112985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7ec39a08-797d-45da-a022-fbca70378206 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:46.114242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7ec39a08-797d-45da-a022-fbca70378206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:46.211340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:46.362405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39072304-aa8a-4c7e-b10b-f1d5a03747cb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:46.363906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-39072304-aa8a-4c7e-b10b-f1d5a03747cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:46.415672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:46.511324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39072304-aa8a-4c7e-b10b-f1d5a03747cb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:46.632948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911588f-59c3-46d1-a593-87ea961a9f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:46.633594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911588f-59c3-46d1-a593-87ea961a9f2e service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:46.633875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911588f-59c3-46d1-a593-87ea961a9f2e service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:46.634150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911588f-59c3-46d1-a593-87ea961a9f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:46.635769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a911588f-59c3-46d1-a593-87ea961a9f2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:46.643174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:46.729397 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911588f-59c3-46d1-a593-87ea961a9f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:46.731002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911588f-59c3-46d1-a593-87ea961a9f2e service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:46.749261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 712/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:47.642290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22980c88-8664-403f-8897-12d6887f354d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:47.642928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22980c88-8664-403f-8897-12d6887f354d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:47.642928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22980c88-8664-403f-8897-12d6887f354d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:47.644109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:47.649477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ccd47-efc5-4dad-937f-301882628185 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:47.649949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ccd47-efc5-4dad-937f-301882628185 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:47.650137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ccd47-efc5-4dad-937f-301882628185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:47.730481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-961ccd47-efc5-4dad-937f-301882628185 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:47.731702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-961ccd47-efc5-4dad-937f-301882628185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:47.801078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:47.830794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:47.981084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22980c88-8664-403f-8897-12d6887f354d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:47.982529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-22980c88-8664-403f-8897-12d6887f354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:48.000350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:48.127668 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22980c88-8664-403f-8897-12d6887f354d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:48.219591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:48.245472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbccbb3-61a3-4cf6-8bb7-c6f89069ee36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:48.245997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbccbb3-61a3-4cf6-8bb7-c6f89069ee36 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:48.246315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbccbb3-61a3-4cf6-8bb7-c6f89069ee36 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:48.246594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbccbb3-61a3-4cf6-8bb7-c6f89069ee36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:48.248237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-afbccbb3-61a3-4cf6-8bb7-c6f89069ee36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:48.345550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbccbb3-61a3-4cf6-8bb7-c6f89069ee36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:48.347505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbccbb3-61a3-4cf6-8bb7-c6f89069ee36 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:48.366325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 721/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:49.242399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e2cc-c7a7-4e35-8635-8617d4ead8c9 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:49.243252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e2cc-c7a7-4e35-8635-8617d4ead8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:49.243429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e2cc-c7a7-4e35-8635-8617d4ead8c9 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:49.244897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:49.250158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133443e-ac88-4a1b-8140-7f2251a729f8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:49.250616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133443e-ac88-4a1b-8140-7f2251a729f8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:49.250711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133443e-ac88-4a1b-8140-7f2251a729f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:49.335954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a133443e-ac88-4a1b-8140-7f2251a729f8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:49.337223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a133443e-ac88-4a1b-8140-7f2251a729f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:49.379530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:49.436164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:49.592385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e2cc-c7a7-4e35-8635-8617d4ead8c9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:49.593926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a21e2cc-c7a7-4e35-8635-8617d4ead8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:49.752715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e2cc-c7a7-4e35-8635-8617d4ead8c9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:49.810313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:49.874892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e06c1e-7e21-4909-b7e9-74d6fb42cebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:49.875518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06c1e-7e21-4909-b7e9-74d6fb42cebd service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:49.875820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06c1e-7e21-4909-b7e9-74d6fb42cebd service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:49.876183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06c1e-7e21-4909-b7e9-74d6fb42cebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:49.877937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-00e06c1e-7e21-4909-b7e9-74d6fb42cebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:49.974929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e06c1e-7e21-4909-b7e9-74d6fb42cebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:49.976568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e06c1e-7e21-4909-b7e9-74d6fb42cebd service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:49.995506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 715/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:50.891035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518e04c-980e-4596-8bff-0354222a7025 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:50.891601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518e04c-980e-4596-8bff-0354222a7025 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:50.891601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518e04c-980e-4596-8bff-0354222a7025 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:50.892967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:50.898351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c65a-7066-40e0-9654-96a94c0b6fa7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:50.898786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c65a-7066-40e0-9654-96a94c0b6fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:50.898881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c65a-7066-40e0-9654-96a94c0b6fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:51.004906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-db90c65a-7066-40e0-9654-96a94c0b6fa7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:51.004906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db90c65a-7066-40e0-9654-96a94c0b6fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:51.004906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:51.083116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:51.234831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518e04c-980e-4596-8bff-0354222a7025 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:51.236646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f518e04c-980e-4596-8bff-0354222a7025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:51.383058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518e04c-980e-4596-8bff-0354222a7025 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:51.411324 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:51.500533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecee14-6cc7-4e49-bcf5-d3f217afea15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:51.501208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecee14-6cc7-4e49-bcf5-d3f217afea15 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:51.501488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecee14-6cc7-4e49-bcf5-d3f217afea15 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:51.501760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecee14-6cc7-4e49-bcf5-d3f217afea15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:51.503395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-baecee14-6cc7-4e49-bcf5-d3f217afea15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:51.594477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecee14-6cc7-4e49-bcf5-d3f217afea15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:51.596078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecee14-6cc7-4e49-bcf5-d3f217afea15 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:51.613742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 724/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:53.435392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db641a3-9ff5-440a-8258-e0218e3bf44d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:53.436086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db641a3-9ff5-440a-8258-e0218e3bf44d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:53.436086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db641a3-9ff5-440a-8258-e0218e3bf44d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:53.437341 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:53.443903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2754a2e-ab90-4f95-b184-f283d5661512 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:53.444869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2754a2e-ab90-4f95-b184-f283d5661512 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:53.445062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2754a2e-ab90-4f95-b184-f283d5661512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:53.492787 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:53.523554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c2754a2e-ab90-4f95-b184-f283d5661512 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:53.524872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c2754a2e-ab90-4f95-b184-f283d5661512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:53.633443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:53.926536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db641a3-9ff5-440a-8258-e0218e3bf44d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:53.928606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5db641a3-9ff5-440a-8258-e0218e3bf44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:54.033045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db641a3-9ff5-440a-8258-e0218e3bf44d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:54.070541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:54.112608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf19f24-a600-41ac-9783-ca8e90df15e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:54.113225 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf19f24-a600-41ac-9783-ca8e90df15e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:54.113494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf19f24-a600-41ac-9783-ca8e90df15e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:54.113764 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf19f24-a600-41ac-9783-ca8e90df15e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:54.116010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bcf19f24-a600-41ac-9783-ca8e90df15e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:54.226070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf19f24-a600-41ac-9783-ca8e90df15e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:54.227555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf19f24-a600-41ac-9783-ca8e90df15e9 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:54.247164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 718/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:56.359210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262947-0e63-45e1-a7d3-ba1c371a7256 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:56.359787 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262947-0e63-45e1-a7d3-ba1c371a7256 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:56.359787 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262947-0e63-45e1-a7d3-ba1c371a7256 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:56.361160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:56.366867 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29451c1d-ca85-4073-84f1-e24f03c02920 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:56.367352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29451c1d-ca85-4073-84f1-e24f03c02920 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:56.367460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29451c1d-ca85-4073-84f1-e24f03c02920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:56.438437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-29451c1d-ca85-4073-84f1-e24f03c02920 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:56.439665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-29451c1d-ca85-4073-84f1-e24f03c02920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:56.453895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:56.542866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:12:56.827635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262947-0e63-45e1-a7d3-ba1c371a7256 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:12:56.829361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-14262947-0e63-45e1-a7d3-ba1c371a7256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:56.931980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262947-0e63-45e1-a7d3-ba1c371a7256 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:12:56.944859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:57.006669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25056c-0a12-41e0-bc15-44e4a8c8d6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:12:57.007291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25056c-0a12-41e0-bc15-44e4a8c8d6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:57.007574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25056c-0a12-41e0-bc15-44e4a8c8d6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:57.007849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25056c-0a12-41e0-bc15-44e4a8c8d6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:57.009536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ca25056c-0a12-41e0-bc15-44e4a8c8d6a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:57.123248 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25056c-0a12-41e0-bc15-44e4a8c8d6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:12:57.125358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25056c-0a12-41e0-bc15-44e4a8c8d6a8 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:12:57.262633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 727/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:12:59.617229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090686ea-ae2a-4eef-ba4f-d75db5e83010 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:59.617812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090686ea-ae2a-4eef-ba4f-d75db5e83010 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:59.617812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090686ea-ae2a-4eef-ba4f-d75db5e83010 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:59.619123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:12:59.624669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74991-b6b5-4376-9015-4636df43ebee None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:12:59.625089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74991-b6b5-4376-9015-4636df43ebee None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:12:59.625211 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74991-b6b5-4376-9015-4636df43ebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:12:59.673544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:12:59.692966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5bf74991-b6b5-4376-9015-4636df43ebee None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:12:59.694183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5bf74991-b6b5-4376-9015-4636df43ebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:12:59.792067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:00.083172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090686ea-ae2a-4eef-ba4f-d75db5e83010 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:00.085312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-090686ea-ae2a-4eef-ba4f-d75db5e83010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:00.191192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090686ea-ae2a-4eef-ba4f-d75db5e83010 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:00.232030 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:00.266624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd924354-2a3d-4cc0-89c4-6b3586a9d0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:00.267730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd924354-2a3d-4cc0-89c4-6b3586a9d0ee service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:00.268012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd924354-2a3d-4cc0-89c4-6b3586a9d0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:00.268317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd924354-2a3d-4cc0-89c4-6b3586a9d0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:00.269939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cd924354-2a3d-4cc0-89c4-6b3586a9d0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:00.378709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd924354-2a3d-4cc0-89c4-6b3586a9d0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:00.380166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd924354-2a3d-4cc0-89c4-6b3586a9d0ee service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:00.399857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 721/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:02.487369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ce640-7793-4091-9087-ab8af898ce55 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:02.487933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ce640-7793-4091-9087-ab8af898ce55 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:02.487933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ce640-7793-4091-9087-ab8af898ce55 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:02.489366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:02.495231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0355c-83c7-44a1-ab22-defe5a8bd757 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:02.495638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0355c-83c7-44a1-ab22-defe5a8bd757 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:02.495780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0355c-83c7-44a1-ab22-defe5a8bd757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:02.562337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-19b0355c-83c7-44a1-ab22-defe5a8bd757 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:02.563543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-19b0355c-83c7-44a1-ab22-defe5a8bd757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:02.583684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:02.659587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:02.941559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ce640-7793-4091-9087-ab8af898ce55 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:02.943094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ba4ce640-7793-4091-9087-ab8af898ce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:03.045578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ce640-7793-4091-9087-ab8af898ce55 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:03.065305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:03.119111 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9f6b-02b0-452b-a306-08d07a18f41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:03.119717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9f6b-02b0-452b-a306-08d07a18f41d service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:03.119993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9f6b-02b0-452b-a306-08d07a18f41d service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:03.120289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9f6b-02b0-452b-a306-08d07a18f41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:03.121880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e7bf9f6b-02b0-452b-a306-08d07a18f41d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:03.234503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf9f6b-02b0-452b-a306-08d07a18f41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:03.235899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf9f6b-02b0-452b-a306-08d07a18f41d service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:03.254483 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 730/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:05.307998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5105-e095-47dc-a482-c1617d2f924e None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:05.308580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5105-e095-47dc-a482-c1617d2f924e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:05.308580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5105-e095-47dc-a482-c1617d2f924e None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:05.309827 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:05.315151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a422b-03de-4529-9df1-babf8f4df10a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:05.315565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a422b-03de-4529-9df1-babf8f4df10a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:05.315721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a422b-03de-4529-9df1-babf8f4df10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:05.379312 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:05.382449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-605a422b-03de-4529-9df1-babf8f4df10a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:05.383671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-605a422b-03de-4529-9df1-babf8f4df10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:05.484731 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:13:05.778320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d5105-e095-47dc-a482-c1617d2f924e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:05.779872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-550d5105-e095-47dc-a482-c1617d2f924e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:06.003415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d5105-e095-47dc-a482-c1617d2f924e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:06.055273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:06.079006 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44b37-dec5-470f-9e4f-65660fa5aa43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:06.079660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44b37-dec5-470f-9e4f-65660fa5aa43 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:06.080018 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44b37-dec5-470f-9e4f-65660fa5aa43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:06.080362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44b37-dec5-470f-9e4f-65660fa5aa43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:06.081936 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-39d44b37-dec5-470f-9e4f-65660fa5aa43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:06.195885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d44b37-dec5-470f-9e4f-65660fa5aa43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:06.197349 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d44b37-dec5-470f-9e4f-65660fa5aa43 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:06.216651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 724/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:08.192917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7abdf2-b068-44c9-980c-c87f5c6704b7 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:08.193479 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7abdf2-b068-44c9-980c-c87f5c6704b7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:08.193479 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7abdf2-b068-44c9-980c-c87f5c6704b7 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:08.194808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:08.200667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36af7d-99bf-471d-9ff2-bcd49f193383 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:08.201121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36af7d-99bf-471d-9ff2-bcd49f193383 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:08.201247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36af7d-99bf-471d-9ff2-bcd49f193383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:08.267956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1d36af7d-99bf-471d-9ff2-bcd49f193383 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:08.269192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d36af7d-99bf-471d-9ff2-bcd49f193383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:08.299285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:08.366770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:08.650697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7abdf2-b068-44c9-980c-c87f5c6704b7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:08.652291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9c7abdf2-b068-44c9-980c-c87f5c6704b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:08.759647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7abdf2-b068-44c9-980c-c87f5c6704b7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:08.789507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:08.835972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af40f5f-c8b2-4870-9b54-c0525027ddb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:08.836608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40f5f-c8b2-4870-9b54-c0525027ddb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:08.836888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40f5f-c8b2-4870-9b54-c0525027ddb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:08.837156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af40f5f-c8b2-4870-9b54-c0525027ddb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:08.838915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5af40f5f-c8b2-4870-9b54-c0525027ddb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:08.964643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af40f5f-c8b2-4870-9b54-c0525027ddb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:08.965997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af40f5f-c8b2-4870-9b54-c0525027ddb2 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:08.985226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 733/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:11.005373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe05e-d5fe-495a-ac32-d709fed757cf None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:11.005915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe05e-d5fe-495a-ac32-d709fed757cf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:11.006038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe05e-d5fe-495a-ac32-d709fed757cf None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:11.007285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:11.012508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e998f-d4b8-4f40-aa34-6e856457b172 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:11.013178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e998f-d4b8-4f40-aa34-6e856457b172 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:11.013339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e998f-d4b8-4f40-aa34-6e856457b172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:11.080100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-df9e998f-d4b8-4f40-aa34-6e856457b172 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:11.081351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-df9e998f-d4b8-4f40-aa34-6e856457b172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:11.090993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:11.183653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:11.472023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fe05e-d5fe-495a-ac32-d709fed757cf None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:11.473719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f2fe05e-d5fe-495a-ac32-d709fed757cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:11.581346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fe05e-d5fe-495a-ac32-d709fed757cf None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:11.641736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:11.661831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c02c7f-9a21-4ad8-b41a-723f57f75fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:11.662360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02c7f-9a21-4ad8-b41a-723f57f75fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:11.662633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02c7f-9a21-4ad8-b41a-723f57f75fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:11.662901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02c7f-9a21-4ad8-b41a-723f57f75fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:11.664523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-24c02c7f-9a21-4ad8-b41a-723f57f75fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:11.773457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c02c7f-9a21-4ad8-b41a-723f57f75fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:11.774872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c02c7f-9a21-4ad8-b41a-723f57f75fb5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:11.793172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 727/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:13.784516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a71b5e-5594-4381-9571-78ecfc32fa2d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:13.785062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a71b5e-5594-4381-9571-78ecfc32fa2d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:13.785062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a71b5e-5594-4381-9571-78ecfc32fa2d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:13.787006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:13.792806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91892d-d1dc-4be8-87f2-aeec94945832 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:13.793305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91892d-d1dc-4be8-87f2-aeec94945832 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:13.793402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91892d-d1dc-4be8-87f2-aeec94945832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:13.861373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0a91892d-d1dc-4be8-87f2-aeec94945832 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:13.862610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0a91892d-d1dc-4be8-87f2-aeec94945832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:13.903692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:13.964002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:14.249237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a71b5e-5594-4381-9571-78ecfc32fa2d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:14.250856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-38a71b5e-5594-4381-9571-78ecfc32fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:14.365938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a71b5e-5594-4381-9571-78ecfc32fa2d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:14.407522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:14.440096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95829faa-39fe-4d66-a778-9c0a166ede7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:14.440721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829faa-39fe-4d66-a778-9c0a166ede7e service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:14.441001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829faa-39fe-4d66-a778-9c0a166ede7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:14.441266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829faa-39fe-4d66-a778-9c0a166ede7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:14.443394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-95829faa-39fe-4d66-a778-9c0a166ede7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:14.554452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95829faa-39fe-4d66-a778-9c0a166ede7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:14.555836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95829faa-39fe-4d66-a778-9c0a166ede7e service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:14.576568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 736/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:16.538695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fa8f2-a24f-4b50-9ade-f5af91867638 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:16.539291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fa8f2-a24f-4b50-9ade-f5af91867638 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:16.539291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fa8f2-a24f-4b50-9ade-f5af91867638 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:16.540702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:16.546219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8c62-9afb-4e8d-91f8-5db6d9ad9d35 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:16.546666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8c62-9afb-4e8d-91f8-5db6d9ad9d35 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:16.546758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8c62-9afb-4e8d-91f8-5db6d9ad9d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:16.615743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0b6a8c62-9afb-4e8d-91f8-5db6d9ad9d35 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:16.616929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0b6a8c62-9afb-4e8d-91f8-5db6d9ad9d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:16.635088 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:16.716472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:16.997624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fa8f2-a24f-4b50-9ade-f5af91867638 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:16.999177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc3fa8f2-a24f-4b50-9ade-f5af91867638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:17.103755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fa8f2-a24f-4b50-9ade-f5af91867638 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:17.171670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:17.178308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403ced2-4236-49b0-9edc-838625ba4a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:17.178910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ced2-4236-49b0-9edc-838625ba4a08 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:17.179180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ced2-4236-49b0-9edc-838625ba4a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:17.179445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ced2-4236-49b0-9edc-838625ba4a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:17.181085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3403ced2-4236-49b0-9edc-838625ba4a08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:17.289453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403ced2-4236-49b0-9edc-838625ba4a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:17.290788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403ced2-4236-49b0-9edc-838625ba4a08 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:17.308986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 730/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:19.272150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f142d-9cc8-4968-a7b6-7f58efeff73c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:19.272777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f142d-9cc8-4968-a7b6-7f58efeff73c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:19.272777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f142d-9cc8-4968-a7b6-7f58efeff73c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:19.274089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:19.279777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab4611-3283-440a-8270-40389609f89a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:19.280412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab4611-3283-440a-8270-40389609f89a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:19.280412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab4611-3283-440a-8270-40389609f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:19.349372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a7ab4611-3283-440a-8270-40389609f89a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:19.350614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a7ab4611-3283-440a-8270-40389609f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:19.399484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:19.448843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:19.730233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f142d-9cc8-4968-a7b6-7f58efeff73c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:19.731942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-742f142d-9cc8-4968-a7b6-7f58efeff73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:19.850371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f142d-9cc8-4968-a7b6-7f58efeff73c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:19.897999 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:19.925223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc6094-39d1-47b4-824e-a9c75da20884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:19.925839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6094-39d1-47b4-824e-a9c75da20884 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:19.926676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6094-39d1-47b4-824e-a9c75da20884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:19.926948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc6094-39d1-47b4-824e-a9c75da20884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:19.928590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cddc6094-39d1-47b4-824e-a9c75da20884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:20.042555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc6094-39d1-47b4-824e-a9c75da20884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:20.043899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc6094-39d1-47b4-824e-a9c75da20884 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:20.062443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 739/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:29.447074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=22 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:30.059911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=66 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:39.851409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514993ea-2dd7-48b7-b908-17873c166e5f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:39.852031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514993ea-2dd7-48b7-b908-17873c166e5f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:39.852031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514993ea-2dd7-48b7-b908-17873c166e5f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:39.853515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 732/1471] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:39.858671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8cd22-6308-49d0-82a5-13eab4b622ca None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:39.859094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8cd22-6308-49d0-82a5-13eab4b622ca None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:39.859204 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8cd22-6308-49d0-82a5-13eab4b622ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:39.929069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-04e8cd22-6308-49d0-82a5-13eab4b622ca None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:39.930336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-04e8cd22-6308-49d0-82a5-13eab4b622ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:40.029594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 740/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:40.325659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e74c1-0950-4b2b-8abe-ba5c976a9830 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:40.325972 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e74c1-0950-4b2b-8abe-ba5c976a9830 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:40.326251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e74c1-0950-4b2b-8abe-ba5c976a9830 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:40.327609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 733/1473] 10.222.0.18 () {54 vars in 967 bytes} [Thu Sep 1 12:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:40.332521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b596-682c-42a7-8e34-d7e470e6fc92 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:40.332837 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b596-682c-42a7-8e34-d7e470e6fc92 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:40.333118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b596-682c-42a7-8e34-d7e470e6fc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:40.411778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5c44b596-682c-42a7-8e34-d7e470e6fc92 None None] MFA Rules not processed for user `76b84587baf0432c800a6278d7095cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:40.413037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5c44b596-682c-42a7-8e34-d7e470e6fc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:40.433829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:40.489495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 741/1474] 10.222.0.18 () {58 vars in 1064 bytes} [Thu Sep 1 12:13:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:40.497173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e74c1-0950-4b2b-8abe-ba5c976a9830 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:40.498742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd4e74c1-0950-4b2b-8abe-ba5c976a9830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:40.605685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e74c1-0950-4b2b-8abe-ba5c976a9830 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:40.682866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da34a2a-e3c0-457a-8f0d-3478793e63a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b84587baf0432c800a6278d7095cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:40.683480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34a2a-e3c0-457a-8f0d-3478793e63a9 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:40.683760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34a2a-e3c0-457a-8f0d-3478793e63a9 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:40.684120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34a2a-e3c0-457a-8f0d-3478793e63a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:40.685813 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2da34a2a-e3c0-457a-8f0d-3478793e63a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:40.742856 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:40.798629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da34a2a-e3c0-457a-8f0d-3478793e63a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:40.800670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da34a2a-e3c0-457a-8f0d-3478793e63a9 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:40.819283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 734/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:42.848081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284504-36c8-4ee6-9aa7-df96fbf4abdc None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:42.848642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284504-36c8-4ee6-9aa7-df96fbf4abdc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:42.848781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284504-36c8-4ee6-9aa7-df96fbf4abdc None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:42.850030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 742/1476] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:13:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:42.855280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3036b-a746-4072-b8cb-8cbfd806e107 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:42.855740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3036b-a746-4072-b8cb-8cbfd806e107 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:42.855855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3036b-a746-4072-b8cb-8cbfd806e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:42.925536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bba3036b-a746-4072-b8cb-8cbfd806e107 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:42.926758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bba3036b-a746-4072-b8cb-8cbfd806e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:43.022908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 735/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:43.303432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97284504-36c8-4ee6-9aa7-df96fbf4abdc None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:43.304924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-97284504-36c8-4ee6-9aa7-df96fbf4abdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:43.432108 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97284504-36c8-4ee6-9aa7-df96fbf4abdc None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:43.483319 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:43.531764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e57e1-1f58-4b0e-b75a-6e8c3fbab8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:43.532404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e57e1-1f58-4b0e-b75a-6e8c3fbab8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:43.532691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e57e1-1f58-4b0e-b75a-6e8c3fbab8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:43.532958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e57e1-1f58-4b0e-b75a-6e8c3fbab8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:43.533636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e57e1-1f58-4b0e-b75a-6e8c3fbab8f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:43.535389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-678e57e1-1f58-4b0e-b75a-6e8c3fbab8f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:13:43.535389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 01 12:13:43.535389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: Sep 01 12:13:43.536570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e57e1-1f58-4b0e-b75a-6e8c3fbab8f8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:43.557096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 743/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Sep 1 12:13:43 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:13:45.519943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2b24-7f61-4fd3-beea-8cc3f4c1c8d4 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:45.520639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2b24-7f61-4fd3-beea-8cc3f4c1c8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:45.520780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2b24-7f61-4fd3-beea-8cc3f4c1c8d4 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:45.522209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 736/1479] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:45.527835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eefb4-c7a2-4d3f-b996-792baf4f19e3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:45.528361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eefb4-c7a2-4d3f-b996-792baf4f19e3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:45.528473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eefb4-c7a2-4d3f-b996-792baf4f19e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:45.599588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e24eefb4-c7a2-4d3f-b996-792baf4f19e3 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:45.600880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e24eefb4-c7a2-4d3f-b996-792baf4f19e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:45.700481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 744/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:45.996020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2b24-7f61-4fd3-beea-8cc3f4c1c8d4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:45.997615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a61d2b24-7f61-4fd3-beea-8cc3f4c1c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:46.007824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:46.145312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2b24-7f61-4fd3-beea-8cc3f4c1c8d4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:46.226698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:46.260704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e71e2-96c8-4ffa-b930-85ec50c4ba8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:46.261645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e71e2-96c8-4ffa-b930-85ec50c4ba8d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:46.262223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e71e2-96c8-4ffa-b930-85ec50c4ba8d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:46.262499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e71e2-96c8-4ffa-b930-85ec50c4ba8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:46.264126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ff5e71e2-96c8-4ffa-b930-85ec50c4ba8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:46.354645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e71e2-96c8-4ffa-b930-85ec50c4ba8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:46.356248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e71e2-96c8-4ffa-b930-85ec50c4ba8d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:46.380417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 737/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:13:48.483361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601af2f6-f926-4004-ad4a-f61801414ddd None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:48.483926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601af2f6-f926-4004-ad4a-f61801414ddd None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:48.483926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601af2f6-f926-4004-ad4a-f61801414ddd None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:48.485421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 745/1482] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:48.491498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba86c3-7d9c-4b18-8dc1-37174bce0268 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:48.491927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba86c3-7d9c-4b18-8dc1-37174bce0268 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:48.492310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba86c3-7d9c-4b18-8dc1-37174bce0268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:48.560715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-42ba86c3-7d9c-4b18-8dc1-37174bce0268 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:48.562003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-42ba86c3-7d9c-4b18-8dc1-37174bce0268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:48.609141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:48.660446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 738/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:48.947882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601af2f6-f926-4004-ad4a-f61801414ddd None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:48.949488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-601af2f6-f926-4004-ad4a-f61801414ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:48.973253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:49.053692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601af2f6-f926-4004-ad4a-f61801414ddd None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:49.127720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e56b2d-7694-4339-9be4-5e0ad1084966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:49.128359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e56b2d-7694-4339-9be4-5e0ad1084966 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:49.128643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e56b2d-7694-4339-9be4-5e0ad1084966 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:49.128914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e56b2d-7694-4339-9be4-5e0ad1084966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:49.130545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-98e56b2d-7694-4339-9be4-5e0ad1084966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:49.205467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:49.242240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e56b2d-7694-4339-9be4-5e0ad1084966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:49.243715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e56b2d-7694-4339-9be4-5e0ad1084966 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:49.262141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 746/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:51.250133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d71f4-3f4b-4ae9-a0cc-22a95500a8fa None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:51.250705 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d71f4-3f4b-4ae9-a0cc-22a95500a8fa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:51.250705 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d71f4-3f4b-4ae9-a0cc-22a95500a8fa None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:51.252048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 739/1485] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:51.257961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b088f-4bda-4575-b246-a1780bd53806 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:51.258438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b088f-4bda-4575-b246-a1780bd53806 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:51.258546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b088f-4bda-4575-b246-a1780bd53806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:51.332700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ca2b088f-4bda-4575-b246-a1780bd53806 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:51.333919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ca2b088f-4bda-4575-b246-a1780bd53806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:51.430257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 747/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:51.732340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d71f4-3f4b-4ae9-a0cc-22a95500a8fa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:51.733880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a81d71f4-3f4b-4ae9-a0cc-22a95500a8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:51.842402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d71f4-3f4b-4ae9-a0cc-22a95500a8fa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:51.915981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:51.917773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb3a6-20d2-4741-8305-f7ed5dff394a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:51.918377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb3a6-20d2-4741-8305-f7ed5dff394a service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:51.918659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb3a6-20d2-4741-8305-f7ed5dff394a service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:51.918935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb3a6-20d2-4741-8305-f7ed5dff394a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:51.920586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-954bb3a6-20d2-4741-8305-f7ed5dff394a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:52.028581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bb3a6-20d2-4741-8305-f7ed5dff394a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:52.029922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bb3a6-20d2-4741-8305-f7ed5dff394a service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:52.047981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 740/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:54.195097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528452a-395b-4ce5-9548-672021852bb2 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:54.195748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528452a-395b-4ce5-9548-672021852bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:54.195748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528452a-395b-4ce5-9548-672021852bb2 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:54.197112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 748/1488] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:54.202959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5350b-ae82-4729-ae6e-2885712b0c08 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:54.203497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5350b-ae82-4729-ae6e-2885712b0c08 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:54.203497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5350b-ae82-4729-ae6e-2885712b0c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:54.275166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e7c5350b-ae82-4729-ae6e-2885712b0c08 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:54.276467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e7c5350b-ae82-4729-ae6e-2885712b0c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:54.343698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:54.397332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 741/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:13:54.704828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528452a-395b-4ce5-9548-672021852bb2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:54.706480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2528452a-395b-4ce5-9548-672021852bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:54.744616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:54.819977 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528452a-395b-4ce5-9548-672021852bb2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:54.900177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5850d6-e552-4b04-8929-826b48f172a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:54.900830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5850d6-e552-4b04-8929-826b48f172a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:54.901110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5850d6-e552-4b04-8929-826b48f172a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:54.901382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5850d6-e552-4b04-8929-826b48f172a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:54.903063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1e5850d6-e552-4b04-8929-826b48f172a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:54.994181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:55.025563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5850d6-e552-4b04-8929-826b48f172a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:55.027347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5850d6-e552-4b04-8929-826b48f172a3 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:55.047470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 749/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:13:57.523894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7ef0-514c-4d44-984a-515d92e8fc5c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:57.524504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7ef0-514c-4d44-984a-515d92e8fc5c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:57.524504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7ef0-514c-4d44-984a-515d92e8fc5c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:57.525820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 742/1491] 10.222.0.18 () {54 vars in 927 bytes} [Thu Sep 1 12:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:13:57.531648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34baa8-9fd5-4adf-af97-d03fe6ca83b4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:57.532357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34baa8-9fd5-4adf-af97-d03fe6ca83b4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:57.532357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34baa8-9fd5-4adf-af97-d03fe6ca83b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:57.604859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8c34baa8-9fd5-4adf-af97-d03fe6ca83b4 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:13:57.606141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8c34baa8-9fd5-4adf-af97-d03fe6ca83b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:57.715615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 750/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Sep 1 12:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:13:58.007922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b7ef0-514c-4d44-984a-515d92e8fc5c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:13:58.009562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-176b7ef0-514c-4d44-984a-515d92e8fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:58.113668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b7ef0-514c-4d44-984a-515d92e8fc5c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:13:58.187100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04099d55-1dcb-477b-87a0-9f25453fa647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:13:58.187707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04099d55-1dcb-477b-87a0-9f25453fa647 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:13:58.187978 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04099d55-1dcb-477b-87a0-9f25453fa647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:13:58.188271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04099d55-1dcb-477b-87a0-9f25453fa647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:13:58.189883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-04099d55-1dcb-477b-87a0-9f25453fa647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:13:58.198943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:13:58.298052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04099d55-1dcb-477b-87a0-9f25453fa647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:13:58.299422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04099d55-1dcb-477b-87a0-9f25453fa647 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:13:58.317687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 743/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:14:07.713712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=82 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:14:08.315380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=50 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:24.185275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b70a8-0d88-498a-98a2-6115b315147b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:24.186056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b70a8-0d88-498a-98a2-6115b315147b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:24.186056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b70a8-0d88-498a-98a2-6115b315147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:24.263792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-419b70a8-0d88-498a-98a2-6115b315147b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:15:24.265118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-419b70a8-0d88-498a-98a2-6115b315147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:24.369226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 751/1494] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:15:24.377752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019582-6dd8-432c-a3f0-a41a7f7fe4c5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:24.378291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019582-6dd8-432c-a3f0-a41a7f7fe4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:24.378291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019582-6dd8-432c-a3f0-a41a7f7fe4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:24.456316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ae019582-6dd8-432c-a3f0-a41a7f7fe4c5 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:15:24.457465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ae019582-6dd8-432c-a3f0-a41a7f7fe4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:24.555385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 744/1495] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:15:24.560384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b70a8-0d88-498a-98a2-6115b315147b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:15:24.561601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-419b70a8-0d88-498a-98a2-6115b315147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:24.573102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b70a8-0d88-498a-98a2-6115b315147b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:15:24.638129 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:24.675310 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:15:24.675930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:24.676264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:24.676513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:24.677168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:15:24.677469 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:15:24.678628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:15:24.678628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 01 12:15:24.678628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: Sep 01 12:15:24.679563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:15:24.692059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 752/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:15:24.701021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae019582-6dd8-432c-a3f0-a41a7f7fe4c5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:15:24.710432 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae019582-6dd8-432c-a3f0-a41a7f7fe4c5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:15:24.775136 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:24.810316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5403320-5a86-4736-a242-80426edc8552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:15:24.810922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5403320-5a86-4736-a242-80426edc8552 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:24.811198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5403320-5a86-4736-a242-80426edc8552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:24.811471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5403320-5a86-4736-a242-80426edc8552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:24.812115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5403320-5a86-4736-a242-80426edc8552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:15:24.813905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-d5403320-5a86-4736-a242-80426edc8552 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:15:24.813905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 01 12:15:24.813905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: Sep 01 12:15:24.815098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5403320-5a86-4736-a242-80426edc8552 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:15:24.939664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 745/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:15:24 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:15:24.946506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:15:24.948241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:24.985500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bd7d5-b38b-4968-b3e2-850cfd726525 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:15:25.103622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865698d-e104-422c-910c-7e2c8e0c0759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:15:25.104248 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865698d-e104-422c-910c-7e2c8e0c0759 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:25.104527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865698d-e104-422c-910c-7e2c8e0c0759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:25.104794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865698d-e104-422c-910c-7e2c8e0c0759 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:25.105435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865698d-e104-422c-910c-7e2c8e0c0759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:15:25.106435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-a865698d-e104-422c-910c-7e2c8e0c0759 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:15:25.106435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 01 12:15:25.106435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: Sep 01 12:15:25.107654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865698d-e104-422c-910c-7e2c8e0c0759 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:15:25.203262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 753/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:15:24 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:15:25.207543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5403320-5a86-4736-a242-80426edc8552 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:15:25.209097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d5403320-5a86-4736-a242-80426edc8552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:25.272091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5403320-5a86-4736-a242-80426edc8552 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:15:25.358057 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:25.368451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8dd77-c65a-447a-a183-1e3de024163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:15:25.369392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8dd77-c65a-447a-a183-1e3de024163b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:25.369671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8dd77-c65a-447a-a183-1e3de024163b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:25.369943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8dd77-c65a-447a-a183-1e3de024163b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:25.370589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8dd77-c65a-447a-a183-1e3de024163b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:15:25.371599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-c8e8dd77-c65a-447a-a183-1e3de024163b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:15:25.371599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 01 12:15:25.371599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: Sep 01 12:15:25.373069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8dd77-c65a-447a-a183-1e3de024163b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:15:25.386304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 746/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:15:25.390649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865698d-e104-422c-910c-7e2c8e0c0759 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:15:25.392178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a865698d-e104-422c-910c-7e2c8e0c0759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:25.404004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865698d-e104-422c-910c-7e2c8e0c0759 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:15:25.430343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:25.502983 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd0bd1-af28-4096-9220-f7a9639e3dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:15:25.503596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd0bd1-af28-4096-9220-f7a9639e3dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:25.503877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd0bd1-af28-4096-9220-f7a9639e3dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:25.504151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd0bd1-af28-4096-9220-f7a9639e3dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:25.504839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd0bd1-af28-4096-9220-f7a9639e3dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:15:25.505857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-11cd0bd1-af28-4096-9220-f7a9639e3dc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:15:25.505857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 01 12:15:25.505857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: Sep 01 12:15:25.507072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd0bd1-af28-4096-9220-f7a9639e3dc9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:15:25.520325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 754/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:15:25.524579 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8dd77-c65a-447a-a183-1e3de024163b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:15:25.526099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c8e8dd77-c65a-447a-a183-1e3de024163b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:25.560083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8dd77-c65a-447a-a183-1e3de024163b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:15:25.662606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e4a67-3444-4a6a-a923-5a824959525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:15:25.663273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4a67-3444-4a6a-a923-5a824959525d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:25.663553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4a67-3444-4a6a-a923-5a824959525d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:25.663836 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4a67-3444-4a6a-a923-5a824959525d admin admin] PATH_INFO: `/v3/projects/35853b94a41b4f01aedc497e495c70e3/users/75acefdd261c45a586d051a717282d5a/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:25.687493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e4a67-3444-4a6a-a923-5a824959525d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35853b94a41b4f01aedc497e495c70e3, user_id=75acefdd261c45a586d051a717282d5a, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:15:25.688568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-984e4a67-3444-4a6a-a923-5a824959525d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:15:25.688568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 01 12:15:25.688568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: Sep 01 12:15:25.690513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e4a67-3444-4a6a-a923-5a824959525d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:15:25.756330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 747/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:15:25 2022] PUT /identity/v3/projects/35853b94a41b4f01aedc497e495c70e3/users/75acefdd261c45a586d051a717282d5a/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:15:25.768827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608c80-c200-44e7-bcb6-9e97aa6824c3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:25.769115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608c80-c200-44e7-bcb6-9e97aa6824c3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:25.769392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608c80-c200-44e7-bcb6-9e97aa6824c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:25.829342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d3608c80-c200-44e7-bcb6-9e97aa6824c3 None None] MFA Rules not processed for user `75acefdd261c45a586d051a717282d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:15:25.830497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d3608c80-c200-44e7-bcb6-9e97aa6824c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:25.911870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 755/1502] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:15:25.925585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf59aa-79a8-41ef-a89f-5ad1b6d0461a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:25.925868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf59aa-79a8-41ef-a89f-5ad1b6d0461a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:25.926148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf59aa-79a8-41ef-a89f-5ad1b6d0461a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:25.927492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 748/1503] 10.222.0.18 () {54 vars in 964 bytes} [Thu Sep 1 12:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:15:25.932635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610559-3d8c-4e10-a1c8-064ad367322c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:25.932926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610559-3d8c-4e10-a1c8-064ad367322c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:25.933206 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610559-3d8c-4e10-a1c8-064ad367322c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:25.967468 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:26.013819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f8610559-3d8c-4e10-a1c8-064ad367322c None None] MFA Rules not processed for user `afb45915b43b471a84fbd363fade7241`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:15:26.015044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f8610559-3d8c-4e10-a1c8-064ad367322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:26.094693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 756/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Sep 1 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:15:26.102607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf59aa-79a8-41ef-a89f-5ad1b6d0461a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:15:26.104142 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1bbf59aa-79a8-41ef-a89f-5ad1b6d0461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:26.155701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:26.214895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf59aa-79a8-41ef-a89f-5ad1b6d0461a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:15:26.291801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7719f44-8719-4642-a600-779368817386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:15:26.292448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7719f44-8719-4642-a600-779368817386 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:26.292736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7719f44-8719-4642-a600-779368817386 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:26.293009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7719f44-8719-4642-a600-779368817386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:26.294704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d7719f44-8719-4642-a600-779368817386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:26.399138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7719f44-8719-4642-a600-779368817386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:15:26.400641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7719f44-8719-4642-a600-779368817386 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:15:26.404493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:26.420579 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 749/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:15:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:15:26.467426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be27e9-0d5f-4bae-91d7-4b69ca7ef213 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:26.467948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be27e9-0d5f-4bae-91d7-4b69ca7ef213 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:26.467948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be27e9-0d5f-4bae-91d7-4b69ca7ef213 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:26.469382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 757/1506] 10.222.0.18 () {52 vars in 830 bytes} [Thu Sep 1 12:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:15:26.473168 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7719f44-8719-4642-a600-779368817386 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:15:26.474380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d7719f44-8719-4642-a600-779368817386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:26.579695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7719f44-8719-4642-a600-779368817386 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:15:26.679102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:15:26.679657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:26.679942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:26.680232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] PATH_INFO: `/v3/users/75acefdd261c45a586d051a717282d5a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:26.694658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] RBAC: Authorizing `identity:delete_user(user_id=75acefdd261c45a586d051a717282d5a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:15:26.695808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:15:26.695808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 01 12:15:26.695808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: Sep 01 12:15:26.697090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:15:26.707999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:26.970963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75acefdd261c45a586d051a717282d5a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:15:26.985509 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75acefdd261c45a586d051a717282d5a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:15:27.096745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75acefdd261c45a586d051a717282d5a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:15:27.097350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75acefdd261c45a586d051a717282d5a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:15:27.097991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75acefdd261c45a586d051a717282d5a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:15:27.129972 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 750/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:15:26 2022] DELETE /identity/v3/users/75acefdd261c45a586d051a717282d5a => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:15:27.134740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9167a69-e4ec-4a4d-8cf2-271d06fcfa3d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:27.135027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9167a69-e4ec-4a4d-8cf2-271d06fcfa3d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:27.135306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9167a69-e4ec-4a4d-8cf2-271d06fcfa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:27.194427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d9167a69-e4ec-4a4d-8cf2-271d06fcfa3d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:15:27.195637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d9167a69-e4ec-4a4d-8cf2-271d06fcfa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:27.272876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:27.285335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 758/1508] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:15:27.295238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:15:27.296547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:27.401020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519271d4-f9a4-4b94-9d91-d0c1ad62800a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:15:27.459720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:27.479715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c93baa-5e89-47b3-977c-b07eba45de3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:15:27.480369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93baa-5e89-47b3-977c-b07eba45de3f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:27.480653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93baa-5e89-47b3-977c-b07eba45de3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:27.480924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93baa-5e89-47b3-977c-b07eba45de3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:27.483109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b3c93baa-5e89-47b3-977c-b07eba45de3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:27.605863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93baa-5e89-47b3-977c-b07eba45de3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:15:27.607720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93baa-5e89-47b3-977c-b07eba45de3f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:15:27.629127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 751/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:15:28.241964 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9167a69-e4ec-4a4d-8cf2-271d06fcfa3d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:15:28.243233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d9167a69-e4ec-4a4d-8cf2-271d06fcfa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:15:28.255163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9167a69-e4ec-4a4d-8cf2-271d06fcfa3d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:15:28.363334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:15:28.363970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:15:28.364285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:15:28.364563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] PATH_INFO: `/v3/projects/35853b94a41b4f01aedc497e495c70e3` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:15:28.374765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35853b94a41b4f01aedc497e495c70e3)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:15:28.375801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:15:28.375801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 01 12:15:28.375801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: Sep 01 12:15:28.377054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:15:28.500641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35853b94a41b4f01aedc497e495c70e3', 'request_id': 'req-584b9c7c-75c6-4949-89d4-47e132b2a800'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:15:28.514110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35853b94a41b4f01aedc497e495c70e3', 'request_id': 'req-584b9c7c-75c6-4949-89d4-47e132b2a800'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:15:28.616740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35853b94a41b4f01aedc497e495c70e3', 'request_id': 'req-584b9c7c-75c6-4949-89d4-47e132b2a800'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:15:28.642199 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] The token cache is being invalidate because project 35853b94a41b4f01aedc497e495c70e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:15:28.642495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:15:28.642931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-584b9c7c-75c6-4949-89d4-47e132b2a800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:15:28.644399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 759/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:15:28 2022] DELETE /identity/v3/projects/35853b94a41b4f01aedc497e495c70e3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:15:37.626733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=62 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:15:38.639972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:17:06.392002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8affb90-7cce-47b8-a265-c8b752f25684 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:06.392620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8affb90-7cce-47b8-a265-c8b752f25684 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:06.392620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8affb90-7cce-47b8-a265-c8b752f25684 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:06.393945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:17:06.399145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd9c18-23a2-4ada-bb04-cc5d6b5fe23e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:06.399798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd9c18-23a2-4ada-bb04-cc5d6b5fe23e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:06.399798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd9c18-23a2-4ada-bb04-cc5d6b5fe23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:06.482303 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-74cd9c18-23a2-4ada-bb04-cc5d6b5fe23e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:17:06.483532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-74cd9c18-23a2-4ada-bb04-cc5d6b5fe23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:06.597708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:17:06.751618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8affb90-7cce-47b8-a265-c8b752f25684 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:17:06.756905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c8affb90-7cce-47b8-a265-c8b752f25684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:06.873109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8affb90-7cce-47b8-a265-c8b752f25684 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:17:06.879033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aae37-7706-4cb2-9294-fa0ae2442019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:17:06.879640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aae37-7706-4cb2-9294-fa0ae2442019 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:06.879919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aae37-7706-4cb2-9294-fa0ae2442019 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:06.880195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aae37-7706-4cb2-9294-fa0ae2442019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:06.888342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aae37-7706-4cb2-9294-fa0ae2442019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:17:06.889919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aae37-7706-4cb2-9294-fa0ae2442019 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:17:06.899198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 753/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:17:07.721794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168e2e-76b8-4611-93b4-3a1397660154 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:07.722339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168e2e-76b8-4611-93b4-3a1397660154 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:07.722339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168e2e-76b8-4611-93b4-3a1397660154 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:07.723694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:17:07.728713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6190-bb09-4dcc-8349-ecbe5fd92918 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:07.729147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6190-bb09-4dcc-8349-ecbe5fd92918 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:07.729267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6190-bb09-4dcc-8349-ecbe5fd92918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:07.748286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3bfe6190-bb09-4dcc-8349-ecbe5fd92918 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:17:07.749466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3bfe6190-bb09-4dcc-8349-ecbe5fd92918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:07.757942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:17:07.911497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c168e2e-76b8-4611-93b4-3a1397660154 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:17:07.925931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c168e2e-76b8-4611-93b4-3a1397660154 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:17:07.931274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea359d6-c611-4d11-a0e8-02c66f7cc89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:17:07.931861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea359d6-c611-4d11-a0e8-02c66f7cc89c service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:07.932136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea359d6-c611-4d11-a0e8-02c66f7cc89c service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:07.932443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea359d6-c611-4d11-a0e8-02c66f7cc89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:07.940812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea359d6-c611-4d11-a0e8-02c66f7cc89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:17:07.942376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea359d6-c611-4d11-a0e8-02c66f7cc89c service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:17:07.951427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 762/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:17:08.075439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6b21d-19d2-4425-a5aa-cb6935924945 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:08.075727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6b21d-19d2-4425-a5aa-cb6935924945 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:08.076001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6b21d-19d2-4425-a5aa-cb6935924945 None None] PATH_INFO: `/v3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:08.077345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 755/1517] 10.222.0.57 () {54 vars in 925 bytes} [Thu Sep 1 12:17:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:17:08.083794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93855c05-f80a-473c-87ee-5e50b08172ec None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:08.084083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93855c05-f80a-473c-87ee-5e50b08172ec None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:08.084438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93855c05-f80a-473c-87ee-5e50b08172ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:08.145245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-93855c05-f80a-473c-87ee-5e50b08172ec None None] MFA Rules not processed for user `81919eaf832b4025a2118feb4e7fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:17:08.146475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-93855c05-f80a-473c-87ee-5e50b08172ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:08.164330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:17:08.218862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 763/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Sep 1 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:17:17.505553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57e7d7-3915-49d2-92e5-893d88b9d7c1 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:17.506092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57e7d7-3915-49d2-92e5-893d88b9d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:17.506092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57e7d7-3915-49d2-92e5-893d88b9d7c1 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:17.507406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 756/1519] 10.222.0.18 () {54 vars in 961 bytes} [Thu Sep 1 12:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:17:17.512548 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ff3f0-6592-4c42-b0db-1b29a2ec3862 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:17.513031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ff3f0-6592-4c42-b0db-1b29a2ec3862 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:17.513159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ff3f0-6592-4c42-b0db-1b29a2ec3862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:17.533102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7b6ff3f0-6592-4c42-b0db-1b29a2ec3862 None None] MFA Rules not processed for user `81919eaf832b4025a2118feb4e7fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:17:17.534291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7b6ff3f0-6592-4c42-b0db-1b29a2ec3862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:17.542722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 764/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Sep 1 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:17:17.550764 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57e7d7-3915-49d2-92e5-893d88b9d7c1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:17:17.564698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57e7d7-3915-49d2-92e5-893d88b9d7c1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:17:17.569666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e11b6f-fcb8-42a0-b402-c28c6d953251 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:17:17.570257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e11b6f-fcb8-42a0-b402-c28c6d953251 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:17.570536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e11b6f-fcb8-42a0-b402-c28c6d953251 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:17.570812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e11b6f-fcb8-42a0-b402-c28c6d953251 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:17.579087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e11b6f-fcb8-42a0-b402-c28c6d953251 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:17:17.581054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e11b6f-fcb8-42a0-b402-c28c6d953251 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:17:17.590786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 757/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:17:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:17:19.189836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbc40-66d1-4e2b-8725-924fe686d672 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:19.190389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbc40-66d1-4e2b-8725-924fe686d672 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:19.190389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbc40-66d1-4e2b-8725-924fe686d672 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:19.191733 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:17:19.196666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cb436-7277-451d-a5b0-786968c0b83c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:19.197141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cb436-7277-451d-a5b0-786968c0b83c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:19.197237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cb436-7277-451d-a5b0-786968c0b83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:19.216870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5b4cb436-7277-451d-a5b0-786968c0b83c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:17:19.218066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5b4cb436-7277-451d-a5b0-786968c0b83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:19.225763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:17:19.379279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fbc40-66d1-4e2b-8725-924fe686d672 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:17:19.393894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fbc40-66d1-4e2b-8725-924fe686d672 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:17:19.400157 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c80428-1e3c-46d2-b1ba-93d017997558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:17:19.400937 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c80428-1e3c-46d2-b1ba-93d017997558 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:19.401295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c80428-1e3c-46d2-b1ba-93d017997558 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:19.401640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c80428-1e3c-46d2-b1ba-93d017997558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:19.412322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c80428-1e3c-46d2-b1ba-93d017997558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:17:19.415540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c80428-1e3c-46d2-b1ba-93d017997558 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:17:19.424543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 766/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:17:20.250544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f324-029a-48ee-b591-ab4a6c0631bc None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:20.251135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f324-029a-48ee-b591-ab4a6c0631bc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:20.251135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f324-029a-48ee-b591-ab4a6c0631bc None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:20.252468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 12:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:17:20.258235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42538583-429c-4c36-af54-6b726b6ebea2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:20.258661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42538583-429c-4c36-af54-6b726b6ebea2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:20.258815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42538583-429c-4c36-af54-6b726b6ebea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:20.279992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-42538583-429c-4c36-af54-6b726b6ebea2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:17:20.281715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-42538583-429c-4c36-af54-6b726b6ebea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:20.289566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:17:20.440098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f324-029a-48ee-b591-ab4a6c0631bc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:17:20.458596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f324-029a-48ee-b591-ab4a6c0631bc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:17:20.464009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44eb2c-df81-4162-99a3-3fdba30ea487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:17:20.464632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44eb2c-df81-4162-99a3-3fdba30ea487 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:20.464914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44eb2c-df81-4162-99a3-3fdba30ea487 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:20.465185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44eb2c-df81-4162-99a3-3fdba30ea487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:20.473742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44eb2c-df81-4162-99a3-3fdba30ea487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:17:20.475309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44eb2c-df81-4162-99a3-3fdba30ea487 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:17:20.485088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 760/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:17:24.398165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e8a9e-bbf4-4151-9cf6-142c60220b4f None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:24.398819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e8a9e-bbf4-4151-9cf6-142c60220b4f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:24.398819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e8a9e-bbf4-4151-9cf6-142c60220b4f None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:24.400074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:17:24.405860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a1631-4524-401c-b7dd-dfafa0b037ac None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:24.406329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a1631-4524-401c-b7dd-dfafa0b037ac None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:24.406433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a1631-4524-401c-b7dd-dfafa0b037ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:24.425909 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b48a1631-4524-401c-b7dd-dfafa0b037ac None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:17:24.427106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b48a1631-4524-401c-b7dd-dfafa0b037ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:24.435091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:17:24.720423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e8a9e-bbf4-4151-9cf6-142c60220b4f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:17:24.722101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ef8e8a9e-bbf4-4151-9cf6-142c60220b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:24.799976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e8a9e-bbf4-4151-9cf6-142c60220b4f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:17:24.803617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bcaea-b718-4b14-a82a-f702020d19f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:17:24.804228 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bcaea-b718-4b14-a82a-f702020d19f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:24.804524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bcaea-b718-4b14-a82a-f702020d19f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:24.804800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bcaea-b718-4b14-a82a-f702020d19f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:24.813683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bcaea-b718-4b14-a82a-f702020d19f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:17:24.815104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bcaea-b718-4b14-a82a-f702020d19f5 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:17:24.824420 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 769/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:17:26.710084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4971a-7dc2-426a-878f-3940ba4c1b44 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:26.710586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4971a-7dc2-426a-878f-3940ba4c1b44 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:26.710718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4971a-7dc2-426a-878f-3940ba4c1b44 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:26.711969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:17:26.717382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc6d0-253b-48f5-921d-930201e6b873 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:26.717819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc6d0-253b-48f5-921d-930201e6b873 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:26.717925 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc6d0-253b-48f5-921d-930201e6b873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:26.737637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-200cc6d0-253b-48f5-921d-930201e6b873 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:17:26.738820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-200cc6d0-253b-48f5-921d-930201e6b873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:26.746677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:17:27.036293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4971a-7dc2-426a-878f-3940ba4c1b44 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:17:27.047558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4971a-7dc2-426a-878f-3940ba4c1b44 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:17:27.051123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca1f4a-d94b-4806-810e-058c6a156899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:17:27.051707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca1f4a-d94b-4806-810e-058c6a156899 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:27.051988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca1f4a-d94b-4806-810e-058c6a156899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:27.052299 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca1f4a-d94b-4806-810e-058c6a156899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:27.061122 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca1f4a-d94b-4806-810e-058c6a156899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:17:27.062537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca1f4a-d94b-4806-810e-058c6a156899 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:17:27.071868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 763/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:17:30.509761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608b4b1-f74f-427c-845b-cdeb06e77419 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:30.510380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608b4b1-f74f-427c-845b-cdeb06e77419 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:30.510380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608b4b1-f74f-427c-845b-cdeb06e77419 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:30.511686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:17:30.517325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60915d-7784-42bf-bcb1-831ded22ba5a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:30.517835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60915d-7784-42bf-bcb1-831ded22ba5a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:30.517942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60915d-7784-42bf-bcb1-831ded22ba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:30.525497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:17:30.537594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4a60915d-7784-42bf-bcb1-831ded22ba5a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:17:30.549425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4a60915d-7784-42bf-bcb1-831ded22ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:30.549425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:17:31.096438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608b4b1-f74f-427c-845b-cdeb06e77419 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:17:31.098099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c608b4b1-f74f-427c-845b-cdeb06e77419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:31.165063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:17:31.179450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608b4b1-f74f-427c-845b-cdeb06e77419 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:17:31.183077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7889f-574e-4e17-8f34-e6c50a8063ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:17:31.183688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7889f-574e-4e17-8f34-e6c50a8063ed service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:31.183971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7889f-574e-4e17-8f34-e6c50a8063ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:31.184406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7889f-574e-4e17-8f34-e6c50a8063ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:31.194098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7889f-574e-4e17-8f34-e6c50a8063ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:17:31.195520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7889f-574e-4e17-8f34-e6c50a8063ed service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:17:31.204914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 772/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:17:33.148104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b053b9e-d020-482e-bd65-f1106bb87ecc None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:33.148680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b053b9e-d020-482e-bd65-f1106bb87ecc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:33.148803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b053b9e-d020-482e-bd65-f1106bb87ecc None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:33.150176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 12:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:17:33.155926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afb94-5f86-4924-aae9-66f80c2769bc None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:33.156386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afb94-5f86-4924-aae9-66f80c2769bc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:33.156493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1afb94-5f86-4924-aae9-66f80c2769bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:33.176308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ce1afb94-5f86-4924-aae9-66f80c2769bc None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:17:33.177509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ce1afb94-5f86-4924-aae9-66f80c2769bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:33.185265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:17:33.737176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b053b9e-d020-482e-bd65-f1106bb87ecc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:17:33.738860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b053b9e-d020-482e-bd65-f1106bb87ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:17:33.752179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b053b9e-d020-482e-bd65-f1106bb87ecc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:17:33.755721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad72c3b-da3f-42c5-9b55-ffa2d2f03e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:17:33.756496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72c3b-da3f-42c5-9b55-ffa2d2f03e0d service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:17:33.756620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72c3b-da3f-42c5-9b55-ffa2d2f03e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:17:33.756888 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72c3b-da3f-42c5-9b55-ffa2d2f03e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:17:33.766639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad72c3b-da3f-42c5-9b55-ffa2d2f03e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:17:33.768037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad72c3b-da3f-42c5-9b55-ffa2d2f03e0d service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:17:33.777727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 766/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:17:43.170994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=11 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:17:43.773269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:09.599238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c1de-f3ff-4ecb-9360-15ef0e900097 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:09.600335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c1de-f3ff-4ecb-9360-15ef0e900097 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:09.600785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c1de-f3ff-4ecb-9360-15ef0e900097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:09.628867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1530c1de-f3ff-4ecb-9360-15ef0e900097 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:09.630393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1530c1de-f3ff-4ecb-9360-15ef0e900097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:09.646872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 774/1540] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:09.657513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eea142-dbbc-435d-a562-19e20db3f6dc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:09.658793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eea142-dbbc-435d-a562-19e20db3f6dc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:09.659264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eea142-dbbc-435d-a562-19e20db3f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:09.693538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972b60c-01a4-4dfb-9f60-5552a0ef278a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:09.694017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972b60c-01a4-4dfb-9f60-5552a0ef278a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:09.694458 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972b60c-01a4-4dfb-9f60-5552a0ef278a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:09.704867 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-01eea142-dbbc-435d-a562-19e20db3f6dc None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:09.707880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-01eea142-dbbc-435d-a562-19e20db3f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:09.728142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7972b60c-01a4-4dfb-9f60-5552a0ef278a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:09.728694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 767/1541] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:09.730115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7972b60c-01a4-4dfb-9f60-5552a0ef278a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:09.732267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eea142-dbbc-435d-a562-19e20db3f6dc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:09.748202 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eea142-dbbc-435d-a562-19e20db3f6dc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:09.760402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 775/1542] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:09.765557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323ead2-3843-4455-9a2f-3cf8ed151520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:09.772069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323ead2-3843-4455-9a2f-3cf8ed151520 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:09.776410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323ead2-3843-4455-9a2f-3cf8ed151520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:09.776410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323ead2-3843-4455-9a2f-3cf8ed151520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:09.776410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323ead2-3843-4455-9a2f-3cf8ed151520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:09.776410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323ead2-3843-4455-9a2f-3cf8ed151520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:09.776410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-a323ead2-3843-4455-9a2f-3cf8ed151520 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:19:09.776410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 01 12:19:09.776410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: Sep 01 12:19:09.776988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc88d4-4623-43e3-8426-ac157dd9ac47 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:09.776988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc88d4-4623-43e3-8426-ac157dd9ac47 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:09.776988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc88d4-4623-43e3-8426-ac157dd9ac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:09.777944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323ead2-3843-4455-9a2f-3cf8ed151520 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:09.814873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 768/1543] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:09.823613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323ead2-3843-4455-9a2f-3cf8ed151520 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:09.836314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-29fc88d4-4623-43e3-8426-ac157dd9ac47 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:09.836314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-29fc88d4-4623-43e3-8426-ac157dd9ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:09.843829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323ead2-3843-4455-9a2f-3cf8ed151520 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:09.856486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfae69-adda-436e-82ba-d418ad52deab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:09.857403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfae69-adda-436e-82ba-d418ad52deab admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:09.858399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfae69-adda-436e-82ba-d418ad52deab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:09.858569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 776/1544] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:09.859351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfae69-adda-436e-82ba-d418ad52deab admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:09.860467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfae69-adda-436e-82ba-d418ad52deab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:09.871088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfae69-adda-436e-82ba-d418ad52deab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:09.876019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc88d4-4623-43e3-8426-ac157dd9ac47 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:09.900119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc88d4-4623-43e3-8426-ac157dd9ac47 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:09.937924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a0da5-fded-4934-93f2-6c734086c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:09.938515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a0da5-fded-4934-93f2-6c734086c636 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:09.938798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a0da5-fded-4934-93f2-6c734086c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:09.939073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a0da5-fded-4934-93f2-6c734086c636 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:09.940108 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a0da5-fded-4934-93f2-6c734086c636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:09.940448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a0da5-fded-4934-93f2-6c734086c636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:09.942069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a0da5-fded-4934-93f2-6c734086c636 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:09.964024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 777/1545] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:09.972395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b07d34-4169-4ce1-91c7-a1228ee28cda None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:09.972691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b07d34-4169-4ce1-91c7-a1228ee28cda None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:09.972978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b07d34-4169-4ce1-91c7-a1228ee28cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.012669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-71b07d34-4169-4ce1-91c7-a1228ee28cda None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.013965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-71b07d34-4169-4ce1-91c7-a1228ee28cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.031098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 778/1546] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.032326 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b07d34-4169-4ce1-91c7-a1228ee28cda None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.043563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b07d34-4169-4ce1-91c7-a1228ee28cda None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.048902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004c39a-a70f-45a9-a951-5da95a0596b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.049515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004c39a-a70f-45a9-a951-5da95a0596b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.050043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004c39a-a70f-45a9-a951-5da95a0596b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.050328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004c39a-a70f-45a9-a951-5da95a0596b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.050957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004c39a-a70f-45a9-a951-5da95a0596b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.052396 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-a004c39a-a70f-45a9-a951-5da95a0596b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:19:10.052396 dv-cinder-839768-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 01 12:19:10.052396 dv-cinder-839768-4-smb devstack@keystone.service[81864]: Sep 01 12:19:10.053077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 769/1547] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:09 2022] POST /identity/v3/projects => generated 389 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:10.054818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1008-231c-498a-a9e7-27ef1129cfbb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.055378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1008-231c-498a-a9e7-27ef1129cfbb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.055887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1008-231c-498a-a9e7-27ef1129cfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.056768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004c39a-a70f-45a9-a951-5da95a0596b7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.079716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d78c1008-231c-498a-a9e7-27ef1129cfbb None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.081087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d78c1008-231c-498a-a9e7-27ef1129cfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.156123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 770/1548] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.157715 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d3d03-18dd-42b1-8511-34f007999ea0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.157951 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d3d03-18dd-42b1-8511-34f007999ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.158212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d3d03-18dd-42b1-8511-34f007999ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.162153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 779/1549] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:10.164041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28ef6-fb2a-40c9-aad6-60953f8714da None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.164368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28ef6-fb2a-40c9-aad6-60953f8714da None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.164660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28ef6-fb2a-40c9-aad6-60953f8714da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.180494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5d9d3d03-18dd-42b1-8511-34f007999ea0 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.181701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5d9d3d03-18dd-42b1-8511-34f007999ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.185647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f4a28ef6-fb2a-40c9-aad6-60953f8714da None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.187563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f4a28ef6-fb2a-40c9-aad6-60953f8714da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.246187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 780/1550] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.253870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 771/1551] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.254046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6eb69-4847-48b8-b65f-39029409baeb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.254469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d3d03-18dd-42b1-8511-34f007999ea0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.254601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6eb69-4847-48b8-b65f-39029409baeb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.254601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6eb69-4847-48b8-b65f-39029409baeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.264177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d3d03-18dd-42b1-8511-34f007999ea0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.268504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8bd6eb69-4847-48b8-b65f-39029409baeb None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.269037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fbdc2-d80b-4177-9116-fea28796015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.269643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fbdc2-d80b-4177-9116-fea28796015e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.269757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8bd6eb69-4847-48b8-b65f-39029409baeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.269927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fbdc2-d80b-4177-9116-fea28796015e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.270198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fbdc2-d80b-4177-9116-fea28796015e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.270825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fbdc2-d80b-4177-9116-fea28796015e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.271833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-9c9fbdc2-d80b-4177-9116-fea28796015e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:19:10.271833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 01 12:19:10.271833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: Sep 01 12:19:10.273060 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fbdc2-d80b-4177-9116-fea28796015e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.277974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 781/1552] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.279017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1420-21ef-4ce7-acb4-e8bb9f93bf08 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.279307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1420-21ef-4ce7-acb4-e8bb9f93bf08 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.280106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1420-21ef-4ce7-acb4-e8bb9f93bf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.300421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-300f1420-21ef-4ce7-acb4-e8bb9f93bf08 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.301617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-300f1420-21ef-4ce7-acb4-e8bb9f93bf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.309706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 782/1553] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.310920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb355-e89a-4554-869c-e3419510d0a0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.311240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb355-e89a-4554-869c-e3419510d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.311519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb355-e89a-4554-869c-e3419510d0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.330550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-785fb355-e89a-4554-869c-e3419510d0a0 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.331799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-785fb355-e89a-4554-869c-e3419510d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.339788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 783/1554] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.341077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963866-fcdc-4ded-a733-47071df3ac4b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.341430 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963866-fcdc-4ded-a733-47071df3ac4b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.341718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963866-fcdc-4ded-a733-47071df3ac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.361766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6e963866-fcdc-4ded-a733-47071df3ac4b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.362959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6e963866-fcdc-4ded-a733-47071df3ac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.364655 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 772/1555] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:10.365332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fbdc2-d80b-4177-9116-fea28796015e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.374130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 784/1556] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.375557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d550-635d-4d8e-a6d7-d98f3cb37a43 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.378088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fbdc2-d80b-4177-9116-fea28796015e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.378218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d550-635d-4d8e-a6d7-d98f3cb37a43 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.378218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d550-635d-4d8e-a6d7-d98f3cb37a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.380507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad5a51-4d68-4b85-9ac9-3e43315b2f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.381107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad5a51-4d68-4b85-9ac9-3e43315b2f07 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.381388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad5a51-4d68-4b85-9ac9-3e43315b2f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.381666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad5a51-4d68-4b85-9ac9-3e43315b2f07 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.382296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad5a51-4d68-4b85-9ac9-3e43315b2f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.384236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad5a51-4d68-4b85-9ac9-3e43315b2f07 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.395820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a609d550-635d-4d8e-a6d7-d98f3cb37a43 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.397044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a609d550-635d-4d8e-a6d7-d98f3cb37a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.405965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 785/1557] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.407317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d5aef-6b8d-4787-bcd7-8a47182d05ea None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.407504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d5aef-6b8d-4787-bcd7-8a47182d05ea None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.407776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d5aef-6b8d-4787-bcd7-8a47182d05ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.428121 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f21d5aef-6b8d-4787-bcd7-8a47182d05ea None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.429330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f21d5aef-6b8d-4787-bcd7-8a47182d05ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.437250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 786/1558] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.438042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d5aef-6b8d-4787-bcd7-8a47182d05ea None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.447173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d5aef-6b8d-4787-bcd7-8a47182d05ea None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.451731 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d24475-f9bc-4bcf-8138-e5ebf94bbd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.452361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d24475-f9bc-4bcf-8138-e5ebf94bbd6a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.456342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d24475-f9bc-4bcf-8138-e5ebf94bbd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.456342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d24475-f9bc-4bcf-8138-e5ebf94bbd6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.456342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d24475-f9bc-4bcf-8138-e5ebf94bbd6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:10.456342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d24475-f9bc-4bcf-8138-e5ebf94bbd6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.456342 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d24475-f9bc-4bcf-8138-e5ebf94bbd6a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.456838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 773/1559] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:10.456932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6267d6b-a068-4ffd-a866-f6124cfbd34f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.457248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6267d6b-a068-4ffd-a866-f6124cfbd34f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.457528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6267d6b-a068-4ffd-a866-f6124cfbd34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.476501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 787/1560] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:10.476501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a510d4-d106-4bc1-97f6-0eac44c1c85c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.476501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a510d4-d106-4bc1-97f6-0eac44c1c85c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.476501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a510d4-d106-4bc1-97f6-0eac44c1c85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.478004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a6267d6b-a068-4ffd-a866-f6124cfbd34f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.479223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a6267d6b-a068-4ffd-a866-f6124cfbd34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.487857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 774/1561] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.488691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6267d6b-a068-4ffd-a866-f6124cfbd34f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.492282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-69a510d4-d106-4bc1-97f6-0eac44c1c85c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:10.493528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-69a510d4-d106-4bc1-97f6-0eac44c1c85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:10.498556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6267d6b-a068-4ffd-a866-f6124cfbd34f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.501922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 788/1562] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:10.501922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a510d4-d106-4bc1-97f6-0eac44c1c85c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.506519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b635-9a0b-4d03-a8e1-39fe67c02997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.507132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b635-9a0b-4d03-a8e1-39fe67c02997 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.507411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b635-9a0b-4d03-a8e1-39fe67c02997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.507685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b635-9a0b-4d03-a8e1-39fe67c02997 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.508362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8b635-9a0b-4d03-a8e1-39fe67c02997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.509955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8b635-9a0b-4d03-a8e1-39fe67c02997 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.512188 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:10.512736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a510d4-d106-4bc1-97f6-0eac44c1c85c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.517528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8ced8-a3e3-4ca3-a8b0-69dc8c8dfa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.518162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ced8-a3e3-4ca3-a8b0-69dc8c8dfa6b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.518503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ced8-a3e3-4ca3-a8b0-69dc8c8dfa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.518844 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ced8-a3e3-4ca3-a8b0-69dc8c8dfa6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.519460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8ced8-a3e3-4ca3-a8b0-69dc8c8dfa6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:10.519764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8ced8-a3e3-4ca3-a8b0-69dc8c8dfa6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.520883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 775/1563] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:10.522281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b635-9a0b-4d03-a8e1-39fe67c02997 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.524527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8ced8-a3e3-4ca3-a8b0-69dc8c8dfa6b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.532639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b635-9a0b-4d03-a8e1-39fe67c02997 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.537350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa686c07-3ba5-45d9-b239-65fbc250c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.544714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 789/1564] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:10.544895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa686c07-3ba5-45d9-b239-65fbc250c9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.544895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa686c07-3ba5-45d9-b239-65fbc250c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.545219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8ced8-a3e3-4ca3-a8b0-69dc8c8dfa6b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.545853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa686c07-3ba5-45d9-b239-65fbc250c9bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.545853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa686c07-3ba5-45d9-b239-65fbc250c9bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:10.545853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa686c07-3ba5-45d9-b239-65fbc250c9bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.545853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa686c07-3ba5-45d9-b239-65fbc250c9bb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.554532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8ced8-a3e3-4ca3-a8b0-69dc8c8dfa6b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.560110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 776/1565] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:10.560110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa686c07-3ba5-45d9-b239-65fbc250c9bb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.564886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19742-b5d9-47c3-bd0c-b71a9b545cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.565507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19742-b5d9-47c3-bd0c-b71a9b545cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.565796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19742-b5d9-47c3-bd0c-b71a9b545cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.566072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a19742-b5d9-47c3-bd0c-b71a9b545cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.566726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19742-b5d9-47c3-bd0c-b71a9b545cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:10.567038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19742-b5d9-47c3-bd0c-b71a9b545cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.568758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a19742-b5d9-47c3-bd0c-b71a9b545cd5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.572053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa686c07-3ba5-45d9-b239-65fbc250c9bb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.577584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea56a1e-a8c4-4e44-9fef-e50f44b0f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.578191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea56a1e-a8c4-4e44-9fef-e50f44b0f409 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.578471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea56a1e-a8c4-4e44-9fef-e50f44b0f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.578755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea56a1e-a8c4-4e44-9fef-e50f44b0f409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.579489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea56a1e-a8c4-4e44-9fef-e50f44b0f409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.581582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea56a1e-a8c4-4e44-9fef-e50f44b0f409 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.582712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 790/1566] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:10.583417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19742-b5d9-47c3-bd0c-b71a9b545cd5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.595337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 777/1567] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:10.595337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea56a1e-a8c4-4e44-9fef-e50f44b0f409 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.595598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a19742-b5d9-47c3-bd0c-b71a9b545cd5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.599644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fae35-3e5d-440f-a418-3dafca610885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.600422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fae35-3e5d-440f-a418-3dafca610885 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.600704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fae35-3e5d-440f-a418-3dafca610885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.600972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fae35-3e5d-440f-a418-3dafca610885 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.601821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fae35-3e5d-440f-a418-3dafca610885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.603559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fae35-3e5d-440f-a418-3dafca610885 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.605130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea56a1e-a8c4-4e44-9fef-e50f44b0f409 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.610123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab2e1-1a31-419b-87ed-ed26a3c5c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.610740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab2e1-1a31-419b-87ed-ed26a3c5c834 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.611019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab2e1-1a31-419b-87ed-ed26a3c5c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.611293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab2e1-1a31-419b-87ed-ed26a3c5c834 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.611961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab2e1-1a31-419b-87ed-ed26a3c5c834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:10.612307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab2e1-1a31-419b-87ed-ed26a3c5c834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.613883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab2e1-1a31-419b-87ed-ed26a3c5c834 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.614909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:10.626891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 778/1568] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:10.634112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab2e1-1a31-419b-87ed-ed26a3c5c834 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.637017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab2e1-1a31-419b-87ed-ed26a3c5c834 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.643429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a5eed-482d-430a-b2dd-4eeff1084aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.644096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5eed-482d-430a-b2dd-4eeff1084aff admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.644447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5eed-482d-430a-b2dd-4eeff1084aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.644733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5eed-482d-430a-b2dd-4eeff1084aff admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.645384 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a5eed-482d-430a-b2dd-4eeff1084aff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:10.645693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a5eed-482d-430a-b2dd-4eeff1084aff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.647287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a5eed-482d-430a-b2dd-4eeff1084aff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.659393 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 779/1569] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:10.660299 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a5eed-482d-430a-b2dd-4eeff1084aff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.671733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a5eed-482d-430a-b2dd-4eeff1084aff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.676450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44051-fecc-489a-9fb5-2eb9076a6126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.677023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44051-fecc-489a-9fb5-2eb9076a6126 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.677298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44051-fecc-489a-9fb5-2eb9076a6126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.677568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44051-fecc-489a-9fb5-2eb9076a6126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.678193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a44051-fecc-489a-9fb5-2eb9076a6126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.679751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a44051-fecc-489a-9fb5-2eb9076a6126 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.690858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 780/1570] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:10.691861 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44051-fecc-489a-9fb5-2eb9076a6126 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.700239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 791/1571] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:10.700239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fae35-3e5d-440f-a418-3dafca610885 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.701911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44051-fecc-489a-9fb5-2eb9076a6126 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.759747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a47607-35d7-40f8-8f4c-695a250fef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.760499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47607-35d7-40f8-8f4c-695a250fef23 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.760871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47607-35d7-40f8-8f4c-695a250fef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.761221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47607-35d7-40f8-8f4c-695a250fef23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.761872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a47607-35d7-40f8-8f4c-695a250fef23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.763777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a47607-35d7-40f8-8f4c-695a250fef23 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.764481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fae35-3e5d-440f-a418-3dafca610885 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.769462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376cc08-99bf-4402-8eb9-477ab75fd258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.770064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376cc08-99bf-4402-8eb9-477ab75fd258 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.770343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376cc08-99bf-4402-8eb9-477ab75fd258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.770615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376cc08-99bf-4402-8eb9-477ab75fd258 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.771248 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376cc08-99bf-4402-8eb9-477ab75fd258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.773215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376cc08-99bf-4402-8eb9-477ab75fd258 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.892843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 781/1572] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:10.893707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a47607-35d7-40f8-8f4c-695a250fef23 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.904647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 792/1573] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/projects => generated 393 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:10.908842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376cc08-99bf-4402-8eb9-477ab75fd258 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:10.956588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a47607-35d7-40f8-8f4c-695a250fef23 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.972689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376cc08-99bf-4402-8eb9-477ab75fd258 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:10.977914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457222d2-cc4a-47c7-ada6-33ccd3bcf77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:10.978518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457222d2-cc4a-47c7-ada6-33ccd3bcf77b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:10.978801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457222d2-cc4a-47c7-ada6-33ccd3bcf77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:10.979075 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457222d2-cc4a-47c7-ada6-33ccd3bcf77b admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:10.979724 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457222d2-cc4a-47c7-ada6-33ccd3bcf77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:10.981163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:10.981411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457222d2-cc4a-47c7-ada6-33ccd3bcf77b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:10.991818 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 793/1574] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:10.993398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457222d2-cc4a-47c7-ada6-33ccd3bcf77b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.004284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457222d2-cc4a-47c7-ada6-33ccd3bcf77b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.008998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8806537-05b4-46f0-b934-d3f47bc7188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.009589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8806537-05b4-46f0-b934-d3f47bc7188b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.009869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8806537-05b4-46f0-b934-d3f47bc7188b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.010145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8806537-05b4-46f0-b934-d3f47bc7188b admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.010775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8806537-05b4-46f0-b934-d3f47bc7188b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.011825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0457b-93f7-4c9f-bb81-fc0ac48f1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.012542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0457b-93f7-4c9f-bb81-fc0ac48f1c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.012699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8806537-05b4-46f0-b934-d3f47bc7188b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.012851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0457b-93f7-4c9f-bb81-fc0ac48f1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.013092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0457b-93f7-4c9f-bb81-fc0ac48f1c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.013722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0457b-93f7-4c9f-bb81-fc0ac48f1c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.015760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0457b-93f7-4c9f-bb81-fc0ac48f1c0f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.102314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 794/1575] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:11.102314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8806537-05b4-46f0-b934-d3f47bc7188b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.153614 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:11.156795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 782/1576] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:10 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:11.160999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0457b-93f7-4c9f-bb81-fc0ac48f1c0f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.166457 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8806537-05b4-46f0-b934-d3f47bc7188b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.224547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0457b-93f7-4c9f-bb81-fc0ac48f1c0f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.225147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a2ba-b019-4d5d-bfb0-0cd8c8c7535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.225796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a2ba-b019-4d5d-bfb0-0cd8c8c7535b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.226080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a2ba-b019-4d5d-bfb0-0cd8c8c7535b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.226357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a2ba-b019-4d5d-bfb0-0cd8c8c7535b admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.227237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257a2ba-b019-4d5d-bfb0-0cd8c8c7535b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.229219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bd385-36bf-4122-b7db-fade454e779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.229720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257a2ba-b019-4d5d-bfb0-0cd8c8c7535b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.229880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bd385-36bf-4122-b7db-fade454e779d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.230161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bd385-36bf-4122-b7db-fade454e779d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.230438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bd385-36bf-4122-b7db-fade454e779d admin admin] PATH_INFO: `/v3/projects/704d97630437484297e0aec818ce4316/users/a51ee88d16004507aa9d199782ced8e5/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.245658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bd385-36bf-4122-b7db-fade454e779d admin admin] RBAC: Authorizing `identity:create_grant(project_id=704d97630437484297e0aec818ce4316, user_id=a51ee88d16004507aa9d199782ced8e5, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.248688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bd385-36bf-4122-b7db-fade454e779d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.355424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 795/1577] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:11 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:11.356437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a2ba-b019-4d5d-bfb0-0cd8c8c7535b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.366933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 783/1578] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:11 2022] PUT /identity/v3/projects/704d97630437484297e0aec818ce4316/users/a51ee88d16004507aa9d199782ced8e5/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:11.367753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bd385-36bf-4122-b7db-fade454e779d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.423791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a2ba-b019-4d5d-bfb0-0cd8c8c7535b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.428756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7c141-2a92-422e-9cc2-718302f16934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.429366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7c141-2a92-422e-9cc2-718302f16934 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.429643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7c141-2a92-422e-9cc2-718302f16934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.429914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7c141-2a92-422e-9cc2-718302f16934 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.430554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7c141-2a92-422e-9cc2-718302f16934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.432088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bd385-36bf-4122-b7db-fade454e779d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.432528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7c141-2a92-422e-9cc2-718302f16934 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.436946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2cd11-98ea-4718-ad8a-10596b3b13d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.437558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2cd11-98ea-4718-ad8a-10596b3b13d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.437871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2cd11-98ea-4718-ad8a-10596b3b13d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.438152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2cd11-98ea-4718-ad8a-10596b3b13d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.438786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2cd11-98ea-4718-ad8a-10596b3b13d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.440733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2cd11-98ea-4718-ad8a-10596b3b13d1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.558170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 796/1579] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:11 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:11.558904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7c141-2a92-422e-9cc2-718302f16934 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.568351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7c141-2a92-422e-9cc2-718302f16934 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.573038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd8372-e8f1-42a4-86e2-473d8f269668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.573610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd8372-e8f1-42a4-86e2-473d8f269668 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.573893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd8372-e8f1-42a4-86e2-473d8f269668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.574196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd8372-e8f1-42a4-86e2-473d8f269668 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.574800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd8372-e8f1-42a4-86e2-473d8f269668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.577545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd8372-e8f1-42a4-86e2-473d8f269668 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.585588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 784/1580] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:11 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:11.586421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2cd11-98ea-4718-ad8a-10596b3b13d1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.597528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2cd11-98ea-4718-ad8a-10596b3b13d1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.602334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f39c24-ce6c-46e9-8d77-4ae6e9ade8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.602983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f39c24-ce6c-46e9-8d77-4ae6e9ade8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.603266 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f39c24-ce6c-46e9-8d77-4ae6e9ade8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.603545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f39c24-ce6c-46e9-8d77-4ae6e9ade8dc admin admin] PATH_INFO: `/v3/projects/33f80dc753424c758bbd02f05cbd829e/users/98ddcad396f14a2eb53704c27bcd8ab2/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.619292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f39c24-ce6c-46e9-8d77-4ae6e9ade8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f80dc753424c758bbd02f05cbd829e, user_id=98ddcad396f14a2eb53704c27bcd8ab2, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.622240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f39c24-ce6c-46e9-8d77-4ae6e9ade8dc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.665550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 797/1581] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:11 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:11.665550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd8372-e8f1-42a4-86e2-473d8f269668 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.673436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd8372-e8f1-42a4-86e2-473d8f269668 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.678134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7d167-42af-49bd-910b-ea82caa52446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.678721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7d167-42af-49bd-910b-ea82caa52446 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.679003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7d167-42af-49bd-910b-ea82caa52446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.679276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7d167-42af-49bd-910b-ea82caa52446 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.679900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7d167-42af-49bd-910b-ea82caa52446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.681883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7d167-42af-49bd-910b-ea82caa52446 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.696272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 785/1582] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:11 2022] PUT /identity/v3/projects/33f80dc753424c758bbd02f05cbd829e/users/98ddcad396f14a2eb53704c27bcd8ab2/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:11.699616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f39c24-ce6c-46e9-8d77-4ae6e9ade8dc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.701999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:11.758893 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f39c24-ce6c-46e9-8d77-4ae6e9ade8dc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.763789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d32b68-5db5-4802-93be-c65e5ed8b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.765097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d32b68-5db5-4802-93be-c65e5ed8b04e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.765273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d32b68-5db5-4802-93be-c65e5ed8b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.765551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d32b68-5db5-4802-93be-c65e5ed8b04e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.766220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d32b68-5db5-4802-93be-c65e5ed8b04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.768241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d32b68-5db5-4802-93be-c65e5ed8b04e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.771106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 798/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:11 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:11.771993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7d167-42af-49bd-910b-ea82caa52446 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.782787 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7d167-42af-49bd-910b-ea82caa52446 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.787675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ca2e0-d449-4311-b989-fb9594f1b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.788311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ca2e0-d449-4311-b989-fb9594f1b2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.788599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ca2e0-d449-4311-b989-fb9594f1b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.788874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ca2e0-d449-4311-b989-fb9594f1b2b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.789506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ca2e0-d449-4311-b989-fb9594f1b2b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.791414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ca2e0-d449-4311-b989-fb9594f1b2b1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.852272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 786/1584] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:11 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:11.853744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58d54-c850-4eb0-80e6-7bde5a398f0f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.854166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58d54-c850-4eb0-80e6-7bde5a398f0f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.854524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58d54-c850-4eb0-80e6-7bde5a398f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.874069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fba58d54-c850-4eb0-80e6-7bde5a398f0f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:11.875300 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fba58d54-c850-4eb0-80e6-7bde5a398f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:11.884596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 787/1585] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:11.888609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba58d54-c850-4eb0-80e6-7bde5a398f0f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.888761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 799/1586] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:11 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:11.888761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ca2e0-d449-4311-b989-fb9594f1b2b1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.896236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba58d54-c850-4eb0-80e6-7bde5a398f0f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.897962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ca2e0-d449-4311-b989-fb9594f1b2b1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.901248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8a41a-dfdf-4dae-ad88-c816ba356ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.901860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8a41a-dfdf-4dae-ad88-c816ba356ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.902133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8a41a-dfdf-4dae-ad88-c816ba356ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.902402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8a41a-dfdf-4dae-ad88-c816ba356ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.902888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a96cf-312b-44c0-8034-df8377fc8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.903076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8a41a-dfdf-4dae-ad88-c816ba356ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.903491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a96cf-312b-44c0-8034-df8377fc8575 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.903775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a96cf-312b-44c0-8034-df8377fc8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.904063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a96cf-312b-44c0-8034-df8377fc8575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.904745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a96cf-312b-44c0-8034-df8377fc8575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.904926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8a41a-dfdf-4dae-ad88-c816ba356ac3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.906493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a96cf-312b-44c0-8034-df8377fc8575 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.918233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 788/1587] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:11.918233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8a41a-dfdf-4dae-ad88-c816ba356ac3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.918506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 800/1588] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:11.918506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42b06-87e6-4984-9a06-a7450e4368a7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.918666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42b06-87e6-4984-9a06-a7450e4368a7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.918904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42b06-87e6-4984-9a06-a7450e4368a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.928462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8a41a-dfdf-4dae-ad88-c816ba356ac3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.932958 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad243ce-29aa-465d-8139-dfa6a259799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.933554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad243ce-29aa-465d-8139-dfa6a259799d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.933830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad243ce-29aa-465d-8139-dfa6a259799d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.934234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad243ce-29aa-465d-8139-dfa6a259799d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.934876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad243ce-29aa-465d-8139-dfa6a259799d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.936979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad243ce-29aa-465d-8139-dfa6a259799d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.939910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:11.946937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 789/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:11.948011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad243ce-29aa-465d-8139-dfa6a259799d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.950018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d1c42b06-87e6-4984-9a06-a7450e4368a7 None None] MFA Rules not processed for user `98ddcad396f14a2eb53704c27bcd8ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:11.951220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d1c42b06-87e6-4984-9a06-a7450e4368a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:11.958822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad243ce-29aa-465d-8139-dfa6a259799d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.963779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a464a59-db4b-4d43-bcef-e42f18d7a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.964415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464a59-db4b-4d43-bcef-e42f18d7a5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.964691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464a59-db4b-4d43-bcef-e42f18d7a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.964969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464a59-db4b-4d43-bcef-e42f18d7a5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.965602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a464a59-db4b-4d43-bcef-e42f18d7a5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.967254 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a464a59-db4b-4d43-bcef-e42f18d7a5e5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:11.977873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 790/1590] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:11.980408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a464a59-db4b-4d43-bcef-e42f18d7a5e5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:11.988188 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a464a59-db4b-4d43-bcef-e42f18d7a5e5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:11.992895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cb062-e9a1-426d-b109-4dac09096308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:11.993479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cb062-e9a1-426d-b109-4dac09096308 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:11.993762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cb062-e9a1-426d-b109-4dac09096308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:11.994037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cb062-e9a1-426d-b109-4dac09096308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:11.994674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cb062-e9a1-426d-b109-4dac09096308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:11.996529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cb062-e9a1-426d-b109-4dac09096308 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.010244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 791/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:12.010244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cb062-e9a1-426d-b109-4dac09096308 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.017797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cb062-e9a1-426d-b109-4dac09096308 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.022405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e0040-31f0-4737-a328-caf579f1b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.022979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0040-31f0-4737-a328-caf579f1b7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.023425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 801/1592] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:12.023559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0040-31f0-4737-a328-caf579f1b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.023559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0040-31f0-4737-a328-caf579f1b7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.024143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e0040-31f0-4737-a328-caf579f1b7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.024276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42b06-87e6-4984-9a06-a7450e4368a7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.025508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d1c42b06-87e6-4984-9a06-a7450e4368a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:12.025745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e0040-31f0-4737-a328-caf579f1b7d4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.036430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 792/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:12.037125 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e0040-31f0-4737-a328-caf579f1b7d4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.047143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e0040-31f0-4737-a328-caf579f1b7d4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.051742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac17ce-0485-4b47-a7cb-d64d1d512c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.052354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac17ce-0485-4b47-a7cb-d64d1d512c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.052638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac17ce-0485-4b47-a7cb-d64d1d512c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.052915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac17ce-0485-4b47-a7cb-d64d1d512c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.053543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac17ce-0485-4b47-a7cb-d64d1d512c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.055120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac17ce-0485-4b47-a7cb-d64d1d512c30 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.065459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 793/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:12.066253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac17ce-0485-4b47-a7cb-d64d1d512c30 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.075516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac17ce-0485-4b47-a7cb-d64d1d512c30 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.080228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70831a-375b-4109-b3f8-e042c44d76d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.080817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70831a-375b-4109-b3f8-e042c44d76d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.081097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70831a-375b-4109-b3f8-e042c44d76d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.081375 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70831a-375b-4109-b3f8-e042c44d76d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.082007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70831a-375b-4109-b3f8-e042c44d76d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.083574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70831a-375b-4109-b3f8-e042c44d76d9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.089741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42b06-87e6-4984-9a06-a7450e4368a7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.093887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bee3d3-c6e5-4ff8-a9c6-a1a8ddaeecc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.094016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 794/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:12.094726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70831a-375b-4109-b3f8-e042c44d76d9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.096892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bee3d3-c6e5-4ff8-a9c6-a1a8ddaeecc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.097284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bee3d3-c6e5-4ff8-a9c6-a1a8ddaeecc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.097568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bee3d3-c6e5-4ff8-a9c6-a1a8ddaeecc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.104039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70831a-375b-4109-b3f8-e042c44d76d9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.107166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bee3d3-c6e5-4ff8-a9c6-a1a8ddaeecc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.109201 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bee3d3-c6e5-4ff8-a9c6-a1a8ddaeecc6 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.109330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27964-f330-46a9-9c78-7498cbb56fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.109788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27964-f330-46a9-9c78-7498cbb56fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.110070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27964-f330-46a9-9c78-7498cbb56fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.110345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27964-f330-46a9-9c78-7498cbb56fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.110977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d27964-f330-46a9-9c78-7498cbb56fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.112567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d27964-f330-46a9-9c78-7498cbb56fc5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.118845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 802/1596] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:12.119680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bee3d3-c6e5-4ff8-a9c6-a1a8ddaeecc6 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.126744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 795/1597] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:12.126744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27964-f330-46a9-9c78-7498cbb56fc5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.132647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bee3d3-c6e5-4ff8-a9c6-a1a8ddaeecc6 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.135651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27964-f330-46a9-9c78-7498cbb56fc5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.138410 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3639ab2-a33d-4d4e-a324-e69357151f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.139562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3639ab2-a33d-4d4e-a324-e69357151f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.140157 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3639ab2-a33d-4d4e-a324-e69357151f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.140466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3639ab2-a33d-4d4e-a324-e69357151f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.141116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3639ab2-a33d-4d4e-a324-e69357151f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.141258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f5151-bcab-43fe-8c35-7537483a9673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.141801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f5151-bcab-43fe-8c35-7537483a9673 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.142083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f5151-bcab-43fe-8c35-7537483a9673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.142377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f5151-bcab-43fe-8c35-7537483a9673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.142702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3639ab2-a33d-4d4e-a324-e69357151f4c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.143001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f5151-bcab-43fe-8c35-7537483a9673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.144622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f5151-bcab-43fe-8c35-7537483a9673 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.153399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 803/1598] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:12.154131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3639ab2-a33d-4d4e-a324-e69357151f4c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.157653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 796/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:12.157653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f5151-bcab-43fe-8c35-7537483a9673 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.164706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3639ab2-a33d-4d4e-a324-e69357151f4c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.169402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79160ff-a68d-49e8-af96-377a8b9eb919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.169837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f5151-bcab-43fe-8c35-7537483a9673 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.169996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79160ff-a68d-49e8-af96-377a8b9eb919 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.170799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79160ff-a68d-49e8-af96-377a8b9eb919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.171074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79160ff-a68d-49e8-af96-377a8b9eb919 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.171695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79160ff-a68d-49e8-af96-377a8b9eb919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.173608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79160ff-a68d-49e8-af96-377a8b9eb919 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.175161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ecbc2-e109-4fe1-af48-044bce7cc150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.175749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ecbc2-e109-4fe1-af48-044bce7cc150 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.176032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ecbc2-e109-4fe1-af48-044bce7cc150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.176348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ecbc2-e109-4fe1-af48-044bce7cc150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.176993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ecbc2-e109-4fe1-af48-044bce7cc150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.178567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ecbc2-e109-4fe1-af48-044bce7cc150 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.189869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 797/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:12.192015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ecbc2-e109-4fe1-af48-044bce7cc150 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.200589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ecbc2-e109-4fe1-af48-044bce7cc150 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.205341 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3274-a18a-4042-87be-3bfef61035b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.205977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3274-a18a-4042-87be-3bfef61035b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.206260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3274-a18a-4042-87be-3bfef61035b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.206540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3274-a18a-4042-87be-3bfef61035b7 admin admin] PATH_INFO: `/v3/projects/782a5a97d0f14212b35b22821c61ca85/users/d27b8d045a8149d6b5ae7e7fbc630e4d/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.221218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb3274-a18a-4042-87be-3bfef61035b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782a5a97d0f14212b35b22821c61ca85, user_id=d27b8d045a8149d6b5ae7e7fbc630e4d, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.226415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb3274-a18a-4042-87be-3bfef61035b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.291218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 804/1601] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:12 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:12.292376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79160ff-a68d-49e8-af96-377a8b9eb919 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.319143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 798/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:12 2022] PUT /identity/v3/projects/782a5a97d0f14212b35b22821c61ca85/users/d27b8d045a8149d6b5ae7e7fbc630e4d/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:12.320033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3274-a18a-4042-87be-3bfef61035b7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.332661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:12.359106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79160ff-a68d-49e8-af96-377a8b9eb919 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.371151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:12.384734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3274-a18a-4042-87be-3bfef61035b7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.390102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137acb5-da48-4236-9e03-d41048386ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.390829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137acb5-da48-4236-9e03-d41048386ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.391416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137acb5-da48-4236-9e03-d41048386ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.391416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137acb5-da48-4236-9e03-d41048386ca8 admin admin] PATH_INFO: `/v3/projects/0f820b1379fb4d6ab182ea9ce923c27b/users/2e9410daf1b242f8ba5ed06e8d4556d6/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.409177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137acb5-da48-4236-9e03-d41048386ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f820b1379fb4d6ab182ea9ce923c27b, user_id=2e9410daf1b242f8ba5ed06e8d4556d6, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.414081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137acb5-da48-4236-9e03-d41048386ca8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.422688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d2059-d9ca-46cb-beff-389295ba7bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.423398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d2059-d9ca-46cb-beff-389295ba7bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.423746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d2059-d9ca-46cb-beff-389295ba7bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.423948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d2059-d9ca-46cb-beff-389295ba7bd0 admin admin] PATH_INFO: `/v3/projects/e643138e3c234990807defb6f77d882b/users/c801eb9fade2483db6fa1560e1aa9b3f/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.444805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d2059-d9ca-46cb-beff-389295ba7bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e643138e3c234990807defb6f77d882b, user_id=c801eb9fade2483db6fa1560e1aa9b3f, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.445856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-cc0d2059-d9ca-46cb-beff-389295ba7bd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:19:12.445856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 01 12:19:12.445856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: Sep 01 12:19:12.447807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d2059-d9ca-46cb-beff-389295ba7bd0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.530628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 799/1603] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:12 2022] PUT /identity/v3/projects/0f820b1379fb4d6ab182ea9ce923c27b/users/2e9410daf1b242f8ba5ed06e8d4556d6/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:12.530957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 805/1604] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:12 2022] PUT /identity/v3/projects/e643138e3c234990807defb6f77d882b/users/c801eb9fade2483db6fa1560e1aa9b3f/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:12.531451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137acb5-da48-4236-9e03-d41048386ca8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.532086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d2059-d9ca-46cb-beff-389295ba7bd0 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.595203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d2059-d9ca-46cb-beff-389295ba7bd0 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.601282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63833863-e319-4d22-85a0-2fec1e9a1b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.601954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63833863-e319-4d22-85a0-2fec1e9a1b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.602282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63833863-e319-4d22-85a0-2fec1e9a1b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.602634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63833863-e319-4d22-85a0-2fec1e9a1b62 admin admin] PATH_INFO: `/v3/projects/4bb99fe4d3e34f9e8eb05fc173ea2d78/users/b66719801f8e4c56a7fc0208704d538f/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.604117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137acb5-da48-4236-9e03-d41048386ca8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.613192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522539f-d9ee-4473-82b7-be129a94bb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.613192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522539f-d9ee-4473-82b7-be129a94bb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.613192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522539f-d9ee-4473-82b7-be129a94bb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.613192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522539f-d9ee-4473-82b7-be129a94bb00 admin admin] PATH_INFO: `/v3/projects/708ba0405e024f0c9b8ed2c5f1775c9b/users/cf491a01dea94a2f93a40324c94d2612/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.621014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63833863-e319-4d22-85a0-2fec1e9a1b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb99fe4d3e34f9e8eb05fc173ea2d78, user_id=b66719801f8e4c56a7fc0208704d538f, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.623876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63833863-e319-4d22-85a0-2fec1e9a1b62 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.627789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522539f-d9ee-4473-82b7-be129a94bb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=708ba0405e024f0c9b8ed2c5f1775c9b, user_id=cf491a01dea94a2f93a40324c94d2612, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.630478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522539f-d9ee-4473-82b7-be129a94bb00 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.692755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 806/1605] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:12 2022] PUT /identity/v3/projects/4bb99fe4d3e34f9e8eb05fc173ea2d78/users/b66719801f8e4c56a7fc0208704d538f/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:12.693362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63833863-e319-4d22-85a0-2fec1e9a1b62 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.719102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 800/1606] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:12 2022] PUT /identity/v3/projects/708ba0405e024f0c9b8ed2c5f1775c9b/users/cf491a01dea94a2f93a40324c94d2612/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:12.720697 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522539f-d9ee-4473-82b7-be129a94bb00 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:12.766271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63833863-e319-4d22-85a0-2fec1e9a1b62 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.797288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:12.799625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522539f-d9ee-4473-82b7-be129a94bb00 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:12.805413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3395847-1567-4e61-b42d-f2874e5fca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.806061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3395847-1567-4e61-b42d-f2874e5fca29 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.806304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3395847-1567-4e61-b42d-f2874e5fca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.806581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3395847-1567-4e61-b42d-f2874e5fca29 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.807211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3395847-1567-4e61-b42d-f2874e5fca29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.809218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3395847-1567-4e61-b42d-f2874e5fca29 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.827942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d2218-3a73-4283-8a14-39d0c8baa816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:12.828765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d2218-3a73-4283-8a14-39d0c8baa816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.829049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d2218-3a73-4283-8a14-39d0c8baa816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.829353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d2218-3a73-4283-8a14-39d0c8baa816 admin admin] PATH_INFO: `/v3/projects/e814d8e27b4144eca0c5721162bee5ee/users/7699159c5e67464ba6b82ec848c24439/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.843985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d2218-3a73-4283-8a14-39d0c8baa816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e814d8e27b4144eca0c5721162bee5ee, user_id=7699159c5e67464ba6b82ec848c24439, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:12.846664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d2218-3a73-4283-8a14-39d0c8baa816 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:12.940570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 801/1607] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:12 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:12.940570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f933a7-386d-4b55-966f-696e3eaba3a6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.940570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f933a7-386d-4b55-966f-696e3eaba3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.940570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f933a7-386d-4b55-966f-696e3eaba3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:12.955107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:12.969822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c7f933a7-386d-4b55-966f-696e3eaba3a6 None None] MFA Rules not processed for user `d27b8d045a8149d6b5ae7e7fbc630e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:12.971052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c7f933a7-386d-4b55-966f-696e3eaba3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:12.979784 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 807/1608] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:12 2022] PUT /identity/v3/projects/e814d8e27b4144eca0c5721162bee5ee/users/7699159c5e67464ba6b82ec848c24439/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:12.981685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83715-e5d6-472d-b1ce-18ad0498f20a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:12.982225 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83715-e5d6-472d-b1ce-18ad0498f20a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:12.982679 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83715-e5d6-472d-b1ce-18ad0498f20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.004474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-37f83715-e5d6-472d-b1ce-18ad0498f20a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:13.014758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-37f83715-e5d6-472d-b1ce-18ad0498f20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:13.048624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 802/1609] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:13.050232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ca19a-9b99-43d5-ad7c-3d275b8fa86d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.050713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ca19a-9b99-43d5-ad7c-3d275b8fa86d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.051147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ca19a-9b99-43d5-ad7c-3d275b8fa86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.076971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 808/1610] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:13.081564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d15b-8a05-4852-9330-43402bf98e71 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.081976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d15b-8a05-4852-9330-43402bf98e71 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.082268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d15b-8a05-4852-9330-43402bf98e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.084181 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c00ca19a-9b99-43d5-ad7c-3d275b8fa86d None None] MFA Rules not processed for user `c801eb9fade2483db6fa1560e1aa9b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:13.085658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c00ca19a-9b99-43d5-ad7c-3d275b8fa86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:13.102734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-dac5d15b-8a05-4852-9330-43402bf98e71 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:13.109415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-dac5d15b-8a05-4852-9330-43402bf98e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:13.111746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 809/1611] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:13.113028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6556a1-414b-42b4-897e-4a4cdbcacd14 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.113327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6556a1-414b-42b4-897e-4a4cdbcacd14 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.113602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6556a1-414b-42b4-897e-4a4cdbcacd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.132895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ca6556a1-414b-42b4-897e-4a4cdbcacd14 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:13.134104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ca6556a1-414b-42b4-897e-4a4cdbcacd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:13.142506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 810/1612] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:13.145179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6556a1-414b-42b4-897e-4a4cdbcacd14 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.156177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6556a1-414b-42b4-897e-4a4cdbcacd14 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.158160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 803/1613] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:13.159508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9220-19b3-47a4-ab22-5a8206b90900 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.159794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9220-19b3-47a4-ab22-5a8206b90900 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.160069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd9220-19b3-47a4-ab22-5a8206b90900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.175912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554571d-078a-46c1-bbd0-3970ec4d5fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.177082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554571d-078a-46c1-bbd0-3970ec4d5fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.177616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554571d-078a-46c1-bbd0-3970ec4d5fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.178090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554571d-078a-46c1-bbd0-3970ec4d5fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.179970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554571d-078a-46c1-bbd0-3970ec4d5fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.181485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b9fd9220-19b3-47a4-ab22-5a8206b90900 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:13.182012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554571d-078a-46c1-bbd0-3970ec4d5fcd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.184692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b9fd9220-19b3-47a4-ab22-5a8206b90900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:13.194668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 804/1614] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:13.195905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd9220-19b3-47a4-ab22-5a8206b90900 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.206620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd9220-19b3-47a4-ab22-5a8206b90900 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.206947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 811/1615] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:13.208026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554571d-078a-46c1-bbd0-3970ec4d5fcd admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.214737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549c54d-1344-458f-be43-f07e90596cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.215490 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549c54d-1344-458f-be43-f07e90596cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.215885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549c54d-1344-458f-be43-f07e90596cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.216372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549c54d-1344-458f-be43-f07e90596cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.217985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549c54d-1344-458f-be43-f07e90596cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.220676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549c54d-1344-458f-be43-f07e90596cfe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.273275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554571d-078a-46c1-bbd0-3970ec4d5fcd admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.277002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1b8fc-f63a-4d67-ae59-fc7b10ef75e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.277613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1b8fc-f63a-4d67-ae59-fc7b10ef75e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.277893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1b8fc-f63a-4d67-ae59-fc7b10ef75e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.278166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1b8fc-f63a-4d67-ae59-fc7b10ef75e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.288356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1b8fc-f63a-4d67-ae59-fc7b10ef75e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.289783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1b8fc-f63a-4d67-ae59-fc7b10ef75e9 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.299527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 812/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:13.301242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1b8fc-f63a-4d67-ae59-fc7b10ef75e9 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.307963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 805/1617] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:13 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:13.307963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549c54d-1344-458f-be43-f07e90596cfe admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.309796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1b8fc-f63a-4d67-ae59-fc7b10ef75e9 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.342567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:13.364498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c589-a5f5-47c3-8b50-4b301b295cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.371100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c589-a5f5-47c3-8b50-4b301b295cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.371100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c589-a5f5-47c3-8b50-4b301b295cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.371100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c589-a5f5-47c3-8b50-4b301b295cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.371399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549c54d-1344-458f-be43-f07e90596cfe admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.371399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467f056-62a1-41e5-8a3a-63e95de6b35f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.371399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467f056-62a1-41e5-8a3a-63e95de6b35f service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.371399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467f056-62a1-41e5-8a3a-63e95de6b35f service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.371772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467f056-62a1-41e5-8a3a-63e95de6b35f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.380850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:13.435035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4c589-a5f5-47c3-8b50-4b301b295cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.436733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467f056-62a1-41e5-8a3a-63e95de6b35f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.437227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4c589-a5f5-47c3-8b50-4b301b295cf2 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.438366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467f056-62a1-41e5-8a3a-63e95de6b35f service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.447710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 813/1618] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:13.448936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62ae55-41c3-4012-9abb-f5d440eb4576 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.451103 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62ae55-41c3-4012-9abb-f5d440eb4576 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.451103 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62ae55-41c3-4012-9abb-f5d440eb4576 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.451103 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 814/1619] 10.222.0.18 () {54 vars in 962 bytes} [Thu Sep 1 12:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:19:13.452059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62ae55-41c3-4012-9abb-f5d440eb4576 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.458275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 806/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:13.459479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467f056-62a1-41e5-8a3a-63e95de6b35f service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.466638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62ae55-41c3-4012-9abb-f5d440eb4576 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.470371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566b131-9e1b-48fb-b2c3-2ef20de70d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.474091 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566b131-9e1b-48fb-b2c3-2ef20de70d73 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.474216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467f056-62a1-41e5-8a3a-63e95de6b35f service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.474339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566b131-9e1b-48fb-b2c3-2ef20de70d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.474339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566b131-9e1b-48fb-b2c3-2ef20de70d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.476532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6bddc-e27a-424e-9e98-01bb25da0822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.477298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6bddc-e27a-424e-9e98-01bb25da0822 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.477579 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6bddc-e27a-424e-9e98-01bb25da0822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.477857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6bddc-e27a-424e-9e98-01bb25da0822 admin admin] PATH_INFO: `/v3/projects/2a7c75b07bc54473afe787e3edc553c5/users/3d65e1ad82f6481a9c2dd8c07a8de930/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.485407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566b131-9e1b-48fb-b2c3-2ef20de70d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.487081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566b131-9e1b-48fb-b2c3-2ef20de70d73 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.496650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6bddc-e27a-424e-9e98-01bb25da0822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7c75b07bc54473afe787e3edc553c5, user_id=3d65e1ad82f6481a9c2dd8c07a8de930, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.500323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6bddc-e27a-424e-9e98-01bb25da0822 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.502317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 815/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:13.508504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566b131-9e1b-48fb-b2c3-2ef20de70d73 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.515687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566b131-9e1b-48fb-b2c3-2ef20de70d73 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.524337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1cb3d-b201-4bad-9a16-032c53f6a6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.525157 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1cb3d-b201-4bad-9a16-032c53f6a6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.525455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1cb3d-b201-4bad-9a16-032c53f6a6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.525738 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1cb3d-b201-4bad-9a16-032c53f6a6a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.526883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1cb3d-b201-4bad-9a16-032c53f6a6a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.528977 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1cb3d-b201-4bad-9a16-032c53f6a6a6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.621540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 807/1622] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:13 2022] PUT /identity/v3/projects/2a7c75b07bc54473afe787e3edc553c5/users/3d65e1ad82f6481a9c2dd8c07a8de930/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:13.626669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c2523-c162-4ffa-a424-121375d0b390 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.627251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c2523-c162-4ffa-a424-121375d0b390 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.627542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c2523-c162-4ffa-a424-121375d0b390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.676556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fd7c2523-c162-4ffa-a424-121375d0b390 None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:13.678138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fd7c2523-c162-4ffa-a424-121375d0b390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:13.702822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 816/1623] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:13 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:13.706494 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1cb3d-b201-4bad-9a16-032c53f6a6a6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.721946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1cb3d-b201-4bad-9a16-032c53f6a6a6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.808009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 808/1624] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Sep 1 12:19:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:13.808788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c2523-c162-4ffa-a424-121375d0b390 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.845134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8383d61-6c98-4cee-97ec-5710eaa28f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.846065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8383d61-6c98-4cee-97ec-5710eaa28f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.846628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8383d61-6c98-4cee-97ec-5710eaa28f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.847118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8383d61-6c98-4cee-97ec-5710eaa28f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.848921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8383d61-6c98-4cee-97ec-5710eaa28f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.852297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8383d61-6c98-4cee-97ec-5710eaa28f15 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.876173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 817/1625] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:13.877596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8383d61-6c98-4cee-97ec-5710eaa28f15 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.894912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8383d61-6c98-4cee-97ec-5710eaa28f15 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.906023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad56c4-b7bb-4267-84f3-a63a00073413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.913789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad56c4-b7bb-4267-84f3-a63a00073413 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.913789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad56c4-b7bb-4267-84f3-a63a00073413 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.913789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad56c4-b7bb-4267-84f3-a63a00073413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.917544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c2523-c162-4ffa-a424-121375d0b390 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.922889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abafe89-9c70-4194-b89b-7ea75ec713a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.923519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abafe89-9c70-4194-b89b-7ea75ec713a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.923868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abafe89-9c70-4194-b89b-7ea75ec713a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.924152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abafe89-9c70-4194-b89b-7ea75ec713a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.924945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abafe89-9c70-4194-b89b-7ea75ec713a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.926926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abafe89-9c70-4194-b89b-7ea75ec713a3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.929795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:13.953594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 809/1626] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:13.953594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abafe89-9c70-4194-b89b-7ea75ec713a3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:13.966317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abafe89-9c70-4194-b89b-7ea75ec713a3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:13.974112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae37dc4-a5fb-4966-bc3a-c6224208498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:13.974821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae37dc4-a5fb-4966-bc3a-c6224208498c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:13.975117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae37dc4-a5fb-4966-bc3a-c6224208498c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:13.976249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae37dc4-a5fb-4966-bc3a-c6224208498c admin admin] PATH_INFO: `/v3/projects/2a7c75b07bc54473afe787e3edc553c5/users/3d65e1ad82f6481a9c2dd8c07a8de930/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:13.978797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae37dc4-a5fb-4966-bc3a-c6224208498c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7c75b07bc54473afe787e3edc553c5, user_id=3d65e1ad82f6481a9c2dd8c07a8de930, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:13.981507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae37dc4-a5fb-4966-bc3a-c6224208498c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:13.991776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:13.998477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 810/1627] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:13 2022] PUT /identity/v3/projects/2a7c75b07bc54473afe787e3edc553c5/users/3d65e1ad82f6481a9c2dd8c07a8de930/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:14.000175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae37dc4-a5fb-4966-bc3a-c6224208498c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:14.007821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad56c4-b7bb-4267-84f3-a63a00073413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:14.010018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad56c4-b7bb-4267-84f3-a63a00073413 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:14.024807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 818/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:14.024807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c394-9826-4e52-b542-80510111ca1b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:14.024807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c394-9826-4e52-b542-80510111ca1b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:14.024807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c394-9826-4e52-b542-80510111ca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:14.078538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-57e1c394-9826-4e52-b542-80510111ca1b None None] MFA Rules not processed for user `3d65e1ad82f6481a9c2dd8c07a8de930`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:14.081127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-57e1c394-9826-4e52-b542-80510111ca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:14.086554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae37dc4-a5fb-4966-bc3a-c6224208498c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:14.094380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a652e46-fd17-48c7-8a5c-51a006fc32d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:14.095508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a652e46-fd17-48c7-8a5c-51a006fc32d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:14.095899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a652e46-fd17-48c7-8a5c-51a006fc32d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:14.096379 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a652e46-fd17-48c7-8a5c-51a006fc32d4 admin admin] PATH_INFO: `/v3/projects/a319dd79a1884e85b7817d3566d99107/users/e44ce6450fef4704b6306bee79a9bd64/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:14.119873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a652e46-fd17-48c7-8a5c-51a006fc32d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a319dd79a1884e85b7817d3566d99107, user_id=e44ce6450fef4704b6306bee79a9bd64, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:14.127313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a652e46-fd17-48c7-8a5c-51a006fc32d4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:14.227072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 811/1629] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:13 2022] PUT /identity/v3/projects/a319dd79a1884e85b7817d3566d99107/users/e44ce6450fef4704b6306bee79a9bd64/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:14.228146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a652e46-fd17-48c7-8a5c-51a006fc32d4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:14.233848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 819/1630] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:14.244871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c394-9826-4e52-b542-80510111ca1b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:14.329468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a652e46-fd17-48c7-8a5c-51a006fc32d4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:14.345035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3f0e3-d882-4dbe-84ba-050f01706586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:14.348016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3f0e3-d882-4dbe-84ba-050f01706586 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:14.349100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3f0e3-d882-4dbe-84ba-050f01706586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:14.349531 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3f0e3-d882-4dbe-84ba-050f01706586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:14.351361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3f0e3-d882-4dbe-84ba-050f01706586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:14.354340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3f0e3-d882-4dbe-84ba-050f01706586 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:14.396300 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 812/1631] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:14.400980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3f0e3-d882-4dbe-84ba-050f01706586 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:14.429035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c394-9826-4e52-b542-80510111ca1b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:14.432098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3f0e3-d882-4dbe-84ba-050f01706586 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:14.459192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4950e32-3900-41cc-a29a-008175b4545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:14.463257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950e32-3900-41cc-a29a-008175b4545c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:14.463597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950e32-3900-41cc-a29a-008175b4545c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:14.464001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950e32-3900-41cc-a29a-008175b4545c admin admin] PATH_INFO: `/v3/projects/a319dd79a1884e85b7817d3566d99107/users/e44ce6450fef4704b6306bee79a9bd64/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:14.743119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4950e32-3900-41cc-a29a-008175b4545c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a319dd79a1884e85b7817d3566d99107, user_id=e44ce6450fef4704b6306bee79a9bd64, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:14.743119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4950e32-3900-41cc-a29a-008175b4545c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:14.743119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 813/1632] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:14 2022] PUT /identity/v3/projects/a319dd79a1884e85b7817d3566d99107/users/e44ce6450fef4704b6306bee79a9bd64/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:14.743119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aca72-aedb-472c-ad2b-f060c6267ccf None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:14.743119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aca72-aedb-472c-ad2b-f060c6267ccf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:14.743119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aca72-aedb-472c-ad2b-f060c6267ccf None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:14.756257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 814/1633] 10.222.0.18 () {54 vars in 912 bytes} [Thu Sep 1 12:19:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:19:14.756257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4337e28-40c9-4e63-8c1e-a33041590eca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:14.756257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4337e28-40c9-4e63-8c1e-a33041590eca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:14.756257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4337e28-40c9-4e63-8c1e-a33041590eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:14.756257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b4337e28-40c9-4e63-8c1e-a33041590eca None None] MFA Rules not processed for user `e44ce6450fef4704b6306bee79a9bd64`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:14.756257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b4337e28-40c9-4e63-8c1e-a33041590eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:14.756967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae266e4-15a8-403f-b04d-70d77df7a3d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:14.756967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae266e4-15a8-403f-b04d-70d77df7a3d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:14.756967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae266e4-15a8-403f-b04d-70d77df7a3d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:14.756967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae266e4-15a8-403f-b04d-70d77df7a3d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:14.757852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:14.758273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:14.758273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae266e4-15a8-403f-b04d-70d77df7a3d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:14.758273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae266e4-15a8-403f-b04d-70d77df7a3d3 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:14.758691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 815/1634] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:14.758691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a9862-978e-4439-bea5-4c820b720dd2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:14.758691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a9862-978e-4439-bea5-4c820b720dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:14.758691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a9862-978e-4439-bea5-4c820b720dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:14.759287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 820/1635] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:14.759369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2c0a9862-978e-4439-bea5-4c820b720dd2 None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:14.759369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c0a9862-978e-4439-bea5-4c820b720dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:14.767484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae266e4-15a8-403f-b04d-70d77df7a3d3 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:14.778260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae266e4-15a8-403f-b04d-70d77df7a3d3 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:14.844195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42e04e-8f24-4bf1-9a0c-b7b8ec43d698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:14.844809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42e04e-8f24-4bf1-9a0c-b7b8ec43d698 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:14.845092 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42e04e-8f24-4bf1-9a0c-b7b8ec43d698 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:14.845416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42e04e-8f24-4bf1-9a0c-b7b8ec43d698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:14.846440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 816/1636] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:14.857870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42e04e-8f24-4bf1-9a0c-b7b8ec43d698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:14.859328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42e04e-8f24-4bf1-9a0c-b7b8ec43d698 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:14.871693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 821/1637] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:15.017648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a9862-978e-4439-bea5-4c820b720dd2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:15.030510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a9862-978e-4439-bea5-4c820b720dd2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:15.049253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511cffd-975b-463e-a308-65255f6a38dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:15.050515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511cffd-975b-463e-a308-65255f6a38dc service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:15.051284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511cffd-975b-463e-a308-65255f6a38dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:15.051701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511cffd-975b-463e-a308-65255f6a38dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:15.076969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511cffd-975b-463e-a308-65255f6a38dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:15.082240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511cffd-975b-463e-a308-65255f6a38dc service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:15.098704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 817/1638] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:15.504066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42e04e-8f24-4bf1-9a0c-b7b8ec43d698 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:15.517809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42e04e-8f24-4bf1-9a0c-b7b8ec43d698 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:15.531128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ce7e4-1ac0-4371-a3bf-a807037cb85a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:15.539473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ce7e4-1ac0-4371-a3bf-a807037cb85a service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:15.539473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ce7e4-1ac0-4371-a3bf-a807037cb85a service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:15.539473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ce7e4-1ac0-4371-a3bf-a807037cb85a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:15.688455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ce7e4-1ac0-4371-a3bf-a807037cb85a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:15.690268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ce7e4-1ac0-4371-a3bf-a807037cb85a service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:15.703793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 822/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:17.075852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63474bd-78e1-4550-8c2f-6e62f9da6db9 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:17.076392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63474bd-78e1-4550-8c2f-6e62f9da6db9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:17.076508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63474bd-78e1-4550-8c2f-6e62f9da6db9 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:17.078504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 818/1640] 10.222.0.18 () {54 vars in 962 bytes} [Thu Sep 1 12:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:19:17.096700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a851-885a-46ad-aef1-01dd803abc61 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:17.096700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a851-885a-46ad-aef1-01dd803abc61 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:17.096700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a851-885a-46ad-aef1-01dd803abc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:17.128562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-aae4a851-885a-46ad-aef1-01dd803abc61 None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:17.137013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-aae4a851-885a-46ad-aef1-01dd803abc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:17.159145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 823/1641] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Sep 1 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:17.160611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e211f-479a-4fcf-8771-e705f3ed9051 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:17.160907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e211f-479a-4fcf-8771-e705f3ed9051 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:17.165774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e211f-479a-4fcf-8771-e705f3ed9051 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:17.165774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 819/1642] 10.222.0.18 () {54 vars in 912 bytes} [Thu Sep 1 12:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:19:17.177245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48a70b-f1ce-4805-979c-6cd2a2fcc069 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:17.177984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48a70b-f1ce-4805-979c-6cd2a2fcc069 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:17.178838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48a70b-f1ce-4805-979c-6cd2a2fcc069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:17.205972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9f48a70b-f1ce-4805-979c-6cd2a2fcc069 None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:17.207636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9f48a70b-f1ce-4805-979c-6cd2a2fcc069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:17.226812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 824/1643] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:17.241910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e211f-479a-4fcf-8771-e705f3ed9051 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:17.256787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e211f-479a-4fcf-8771-e705f3ed9051 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:17.262263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055da2c0-62ab-41e2-aa13-05cc012f2cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:17.263080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da2c0-62ab-41e2-aa13-05cc012f2cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:17.263539 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da2c0-62ab-41e2-aa13-05cc012f2cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:17.263817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da2c0-62ab-41e2-aa13-05cc012f2cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:17.279963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055da2c0-62ab-41e2-aa13-05cc012f2cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:17.281159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055da2c0-62ab-41e2-aa13-05cc012f2cb1 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:17.304303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 820/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:17.776321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48a70b-f1ce-4805-979c-6cd2a2fcc069 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:17.946213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48a70b-f1ce-4805-979c-6cd2a2fcc069 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:17.959663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:17.962009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:17.964423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:17.966229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] PATH_INFO: `/v3/users/98ddcad396f14a2eb53704c27bcd8ab2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:17.970687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ddcad396f14a2eb53704c27bcd8ab2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:17.981450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:19:17.981450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 01 12:19:17.981450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: Sep 01 12:19:17.983859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:18.006086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:18.293921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ddcad396f14a2eb53704c27bcd8ab2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:18.320718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ddcad396f14a2eb53704c27bcd8ab2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:18.324901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ddcad396f14a2eb53704c27bcd8ab2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:18.505903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ddcad396f14a2eb53704c27bcd8ab2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:18.541964 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ddcad396f14a2eb53704c27bcd8ab2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:18.558459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 825/1645] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:17 2022] DELETE /identity/v3/users/98ddcad396f14a2eb53704c27bcd8ab2 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:18.558637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07617-d231-4462-8270-5fc41199edc2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:18.559143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07617-d231-4462-8270-5fc41199edc2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:18.559143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07617-d231-4462-8270-5fc41199edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:18.600606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4ca07617-d231-4462-8270-5fc41199edc2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:18.602267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ca07617-d231-4462-8270-5fc41199edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:18.724529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 821/1646] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:19:18.754002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:18.756994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:18.869385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed3ed0-73aa-4447-ba51-f6f8534e5136 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:18.877049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74f69-d8b2-49ee-a1e4-55b8be961730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:18.878140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74f69-d8b2-49ee-a1e4-55b8be961730 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:18.878611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74f69-d8b2-49ee-a1e4-55b8be961730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:18.879068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74f69-d8b2-49ee-a1e4-55b8be961730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:18.908910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d74f69-d8b2-49ee-a1e4-55b8be961730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:18.911377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d74f69-d8b2-49ee-a1e4-55b8be961730 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:18.926183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 826/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:21.457711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07617-d231-4462-8270-5fc41199edc2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:21.459264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ca07617-d231-4462-8270-5fc41199edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:21.486068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07617-d231-4462-8270-5fc41199edc2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:21.500771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:21.501435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:21.501709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:21.501986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] PATH_INFO: `/v3/projects/33f80dc753424c758bbd02f05cbd829e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:21.503134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f80dc753424c758bbd02f05cbd829e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:21.504156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 12:19:21.504156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 01 12:19:21.504156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: Sep 01 12:19:21.505376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:21.653426 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:21.689048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f80dc753424c758bbd02f05cbd829e', 'request_id': 'req-392504f4-336d-423c-af65-b463fdc9a329'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:21.724828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f80dc753424c758bbd02f05cbd829e', 'request_id': 'req-392504f4-336d-423c-af65-b463fdc9a329'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:21.745204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f80dc753424c758bbd02f05cbd829e', 'request_id': 'req-392504f4-336d-423c-af65-b463fdc9a329'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:21.892146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] The token cache is being invalidate because project 33f80dc753424c758bbd02f05cbd829e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:21.892694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:21.893680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:21.895772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 822/1648] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:21 2022] DELETE /identity/v3/projects/33f80dc753424c758bbd02f05cbd829e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:21.899330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74f69-d8b2-49ee-a1e4-55b8be961730 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:21.928549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74f69-d8b2-49ee-a1e4-55b8be961730 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:22.087935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:22.090804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:22.091118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:22.091398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] PATH_INFO: `/v3/users/3d65e1ad82f6481a9c2dd8c07a8de930` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:22.094454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d65e1ad82f6481a9c2dd8c07a8de930)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:22.100409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:22.274394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:22.382906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d65e1ad82f6481a9c2dd8c07a8de930'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:22.394119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d65e1ad82f6481a9c2dd8c07a8de930'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:22.395121 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d65e1ad82f6481a9c2dd8c07a8de930'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:22.470623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d65e1ad82f6481a9c2dd8c07a8de930'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:22.509028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b7a87401-1175-4eb5-bc0d-ca0fa991876f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d65e1ad82f6481a9c2dd8c07a8de930'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:22.528930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 827/1649] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:21 2022] DELETE /identity/v3/users/3d65e1ad82f6481a9c2dd8c07a8de930 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:24.408377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:24.410064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:24.446157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392504f4-336d-423c-af65-b463fdc9a329 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:24.649157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:24.650121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:24.650546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:24.650960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] PATH_INFO: `/v3/projects/2a7c75b07bc54473afe787e3edc553c5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:24.652401 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7c75b07bc54473afe787e3edc553c5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:24.655226 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:24.865822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7c75b07bc54473afe787e3edc553c5', 'request_id': 'req-e766dca0-972a-4a29-8660-dd65ec8a0574'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:24.885949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7c75b07bc54473afe787e3edc553c5', 'request_id': 'req-e766dca0-972a-4a29-8660-dd65ec8a0574'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:24.914561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7c75b07bc54473afe787e3edc553c5', 'request_id': 'req-e766dca0-972a-4a29-8660-dd65ec8a0574'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:25.010693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] The token cache is being invalidate because project 2a7c75b07bc54473afe787e3edc553c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:25.010693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:25.012949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:25.016776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 823/1650] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:24 2022] DELETE /identity/v3/projects/2a7c75b07bc54473afe787e3edc553c5 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:25.021538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7be7-5571-4cba-b0a2-2604760cad21 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:25.022420 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7be7-5571-4cba-b0a2-2604760cad21 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:25.022863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7be7-5571-4cba-b0a2-2604760cad21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:25.114944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-337a7be7-5571-4cba-b0a2-2604760cad21 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:25.119468 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-337a7be7-5571-4cba-b0a2-2604760cad21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:25.212572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:25.214178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:25.381237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 828/1651] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:25.390377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc94fa-c83f-46a6-84e8-bd1856d5cc8e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:25.390672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc94fa-c83f-46a6-84e8-bd1856d5cc8e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:25.391953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc94fa-c83f-46a6-84e8-bd1856d5cc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:25.439683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:25.457074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766dca0-972a-4a29-8660-dd65ec8a0574 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:25.464727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7fdc94fa-c83f-46a6-84e8-bd1856d5cc8e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:25.469295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7fdc94fa-c83f-46a6-84e8-bd1856d5cc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:25.475443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:25.476389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:25.476948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:25.477424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] PATH_INFO: `/v3/users/c801eb9fade2483db6fa1560e1aa9b3f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:25.480558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c801eb9fade2483db6fa1560e1aa9b3f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:25.482720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:25.505276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 829/1652] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:25.506466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc94fa-c83f-46a6-84e8-bd1856d5cc8e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:25.519835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc94fa-c83f-46a6-84e8-bd1856d5cc8e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:25.535773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff237b35-124a-4c20-b351-7b39e376cf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:25.536655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff237b35-124a-4c20-b351-7b39e376cf97 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:25.537078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff237b35-124a-4c20-b351-7b39e376cf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:25.537489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff237b35-124a-4c20-b351-7b39e376cf97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:25.538300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff237b35-124a-4c20-b351-7b39e376cf97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:25.538783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff237b35-124a-4c20-b351-7b39e376cf97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:25.541873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff237b35-124a-4c20-b351-7b39e376cf97 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:25.568132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 830/1653] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:25.572480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff237b35-124a-4c20-b351-7b39e376cf97 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:25.595723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff237b35-124a-4c20-b351-7b39e376cf97 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:25.609031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919392-49fc-4e0d-99ba-aaffbf225bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:25.609601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919392-49fc-4e0d-99ba-aaffbf225bad admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:25.609892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919392-49fc-4e0d-99ba-aaffbf225bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:25.610205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919392-49fc-4e0d-99ba-aaffbf225bad admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:25.610862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04919392-49fc-4e0d-99ba-aaffbf225bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:25.612858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04919392-49fc-4e0d-99ba-aaffbf225bad admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:25.789986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c801eb9fade2483db6fa1560e1aa9b3f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:25.813065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c801eb9fade2483db6fa1560e1aa9b3f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:25.825792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 831/1654] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:25 2022] POST /identity/v3/projects => generated 367 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:19:25.834551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919392-49fc-4e0d-99ba-aaffbf225bad admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:25.931935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c801eb9fade2483db6fa1560e1aa9b3f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:25.933565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c801eb9fade2483db6fa1560e1aa9b3f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:25.933565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9e70f5de-57a1-4d62-a04e-d433a7cda08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c801eb9fade2483db6fa1560e1aa9b3f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:26.003914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 824/1655] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:25 2022] DELETE /identity/v3/users/c801eb9fade2483db6fa1560e1aa9b3f => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:26.008908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b32ac-7f7a-4119-910b-9b2ca30177b0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:26.009310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b32ac-7f7a-4119-910b-9b2ca30177b0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:26.009466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b32ac-7f7a-4119-910b-9b2ca30177b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:26.024686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919392-49fc-4e0d-99ba-aaffbf225bad admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:26.056325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:26.083301 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-492b32ac-7f7a-4119-910b-9b2ca30177b0 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:26.089843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-492b32ac-7f7a-4119-910b-9b2ca30177b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:26.215487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc022e-b2a9-488a-8dbb-4b4d27c3c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:26.218687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc022e-b2a9-488a-8dbb-4b4d27c3c9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:26.219023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc022e-b2a9-488a-8dbb-4b4d27c3c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:26.219302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc022e-b2a9-488a-8dbb-4b4d27c3c9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:26.219976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc022e-b2a9-488a-8dbb-4b4d27c3c9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:26.230103 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc022e-b2a9-488a-8dbb-4b4d27c3c9d5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:26.296165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 825/1656] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:19:26.345552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 832/1657] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:25 2022] POST /identity/v3/users => generated 284 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:26.349469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b32ac-7f7a-4119-910b-9b2ca30177b0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:26.351030 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-492b32ac-7f7a-4119-910b-9b2ca30177b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:26.370871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b32ac-7f7a-4119-910b-9b2ca30177b0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:26.385447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15065b-cb1e-4017-a4ff-25eb256a79fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:26.386090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15065b-cb1e-4017-a4ff-25eb256a79fd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:26.386372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15065b-cb1e-4017-a4ff-25eb256a79fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:26.386649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15065b-cb1e-4017-a4ff-25eb256a79fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:26.387488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15065b-cb1e-4017-a4ff-25eb256a79fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:26.389204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15065b-cb1e-4017-a4ff-25eb256a79fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:26.412337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 826/1658] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:26.416641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc022e-b2a9-488a-8dbb-4b4d27c3c9d5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:26.434477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc022e-b2a9-488a-8dbb-4b4d27c3c9d5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:26.445127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac5d3-32c3-4b46-abb2-ee89567ad0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:26.446008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac5d3-32c3-4b46-abb2-ee89567ad0ee admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:26.447137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac5d3-32c3-4b46-abb2-ee89567ad0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:26.448431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac5d3-32c3-4b46-abb2-ee89567ad0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:26.452666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aac5d3-32c3-4b46-abb2-ee89567ad0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:26.455048 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aac5d3-32c3-4b46-abb2-ee89567ad0ee admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:26.485841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 833/1659] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:26.490229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15065b-cb1e-4017-a4ff-25eb256a79fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:26.512503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac5d3-32c3-4b46-abb2-ee89567ad0ee admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:26.517530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e0aac5d3-32c3-4b46-abb2-ee89567ad0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:26.524295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15065b-cb1e-4017-a4ff-25eb256a79fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:26.541811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c29cd-be19-4ca9-9725-1b411ac75625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:26.542509 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c29cd-be19-4ca9-9725-1b411ac75625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:26.542794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c29cd-be19-4ca9-9725-1b411ac75625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:26.543072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c29cd-be19-4ca9-9725-1b411ac75625 admin admin] PATH_INFO: `/v3/projects/03ccd949e43940a9b95c73f054536ed8/users/33b254a1edbc4221b174899ead70cb43/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:26.593898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c29cd-be19-4ca9-9725-1b411ac75625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ccd949e43940a9b95c73f054536ed8, user_id=33b254a1edbc4221b174899ead70cb43, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:26.601090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c29cd-be19-4ca9-9725-1b411ac75625 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:26.696961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac5d3-32c3-4b46-abb2-ee89567ad0ee admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:26.702640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6992c-f830-49d1-938d-cdeebeab8b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:26.703634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6992c-f830-49d1-938d-cdeebeab8b2f service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:26.708194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6992c-f830-49d1-938d-cdeebeab8b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:26.708825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6992c-f830-49d1-938d-cdeebeab8b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:26.722261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6992c-f830-49d1-938d-cdeebeab8b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:26.725187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6992c-f830-49d1-938d-cdeebeab8b2f service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:26.743076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 834/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:26.773563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 827/1661] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:26 2022] PUT /identity/v3/projects/03ccd949e43940a9b95c73f054536ed8/users/33b254a1edbc4221b174899ead70cb43/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:26.784166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149ef7c-5f77-4655-9b32-9f4be4679939 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:26.784876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149ef7c-5f77-4655-9b32-9f4be4679939 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:26.785350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149ef7c-5f77-4655-9b32-9f4be4679939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:26.848891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1149ef7c-5f77-4655-9b32-9f4be4679939 None None] MFA Rules not processed for user `33b254a1edbc4221b174899ead70cb43`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:26.851815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1149ef7c-5f77-4655-9b32-9f4be4679939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:27.027131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 835/1662] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:27.028763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c29cd-be19-4ca9-9725-1b411ac75625 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:27.198649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c29cd-be19-4ca9-9725-1b411ac75625 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:27.209072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c39c9-e631-45e1-a096-0e0cfa023a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:27.209734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c39c9-e631-45e1-a096-0e0cfa023a17 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:27.210018 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c39c9-e631-45e1-a096-0e0cfa023a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:27.210468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c39c9-e631-45e1-a096-0e0cfa023a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:27.211147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c39c9-e631-45e1-a096-0e0cfa023a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:27.213127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c39c9-e631-45e1-a096-0e0cfa023a17 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:27.391109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:27.401541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 828/1663] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:27 2022] POST /identity/v3/projects => generated 367 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:27.405604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149ef7c-5f77-4655-9b32-9f4be4679939 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:27.431352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149ef7c-5f77-4655-9b32-9f4be4679939 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:27.564509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9bb32-6223-43f9-b5c4-3a007ba876c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:27.565507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9bb32-6223-43f9-b5c4-3a007ba876c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:27.565951 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9bb32-6223-43f9-b5c4-3a007ba876c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:27.566396 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9bb32-6223-43f9-b5c4-3a007ba876c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:27.567209 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9bb32-6223-43f9-b5c4-3a007ba876c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:27.571809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9bb32-6223-43f9-b5c4-3a007ba876c8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:27.706098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 836/1664] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:27 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:27.713827 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c39c9-e631-45e1-a096-0e0cfa023a17 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:27.715851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9bb32-6223-43f9-b5c4-3a007ba876c8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:27.725980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-28d9bb32-6223-43f9-b5c4-3a007ba876c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:27.746897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c39c9-e631-45e1-a096-0e0cfa023a17 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:27.767458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553da77-937c-4d9a-a24c-6168524809de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:27.768463 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553da77-937c-4d9a-a24c-6168524809de admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:27.770433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553da77-937c-4d9a-a24c-6168524809de admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:27.771133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9bb32-6223-43f9-b5c4-3a007ba876c8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:27.771632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553da77-937c-4d9a-a24c-6168524809de admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:27.778928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553da77-937c-4d9a-a24c-6168524809de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:27.784439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553da77-937c-4d9a-a24c-6168524809de admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:27.785938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:27.791516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:27.794084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:27.795362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:27.798512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] PATH_INFO: `/v3/users/d27b8d045a8149d6b5ae7e7fbc630e4d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:27.804357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27b8d045a8149d6b5ae7e7fbc630e4d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:27.814985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:27.825916 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 829/1665] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:27.834277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553da77-937c-4d9a-a24c-6168524809de admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:27.871973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553da77-937c-4d9a-a24c-6168524809de admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:27.891247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8d75-f7b7-48d4-8c4e-aa28e2a2c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:27.893036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8d75-f7b7-48d4-8c4e-aa28e2a2c8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:27.894780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8d75-f7b7-48d4-8c4e-aa28e2a2c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:27.895241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8d75-f7b7-48d4-8c4e-aa28e2a2c8b9 admin admin] PATH_INFO: `/v3/projects/6825f27b1c7b471c8f9ae2d5f0fec1fd/users/3788cf4ade9e4adbadeb9dab29853495/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:27.941425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8d75-f7b7-48d4-8c4e-aa28e2a2c8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6825f27b1c7b471c8f9ae2d5f0fec1fd, user_id=3788cf4ade9e4adbadeb9dab29853495, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:27.948966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8d75-f7b7-48d4-8c4e-aa28e2a2c8b9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:28.104866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 830/1666] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:27 2022] PUT /identity/v3/projects/6825f27b1c7b471c8f9ae2d5f0fec1fd/users/3788cf4ade9e4adbadeb9dab29853495/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:28.109364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8d75-f7b7-48d4-8c4e-aa28e2a2c8b9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:28.154154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27b8d045a8149d6b5ae7e7fbc630e4d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:28.168589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27b8d045a8149d6b5ae7e7fbc630e4d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:28.169299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27b8d045a8149d6b5ae7e7fbc630e4d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:28.279112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27b8d045a8149d6b5ae7e7fbc630e4d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:28.304930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d5ed5b05-b63b-4a27-b9cb-1c099f56da83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27b8d045a8149d6b5ae7e7fbc630e4d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:28.319864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 837/1667] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:27 2022] DELETE /identity/v3/users/d27b8d045a8149d6b5ae7e7fbc630e4d => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:28.325650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf9e4-c570-40a4-b978-bd5881d70d69 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:28.325650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf9e4-c570-40a4-b978-bd5881d70d69 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:28.325650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf9e4-c570-40a4-b978-bd5881d70d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:28.363153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8d75-f7b7-48d4-8c4e-aa28e2a2c8b9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:28.378123 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8c7bf9e4-c570-40a4-b978-bd5881d70d69 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:28.379409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8c7bf9e4-c570-40a4-b978-bd5881d70d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:28.606218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 838/1668] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:28.607969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83aa91-06e0-47bc-8158-c3d646948697 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:28.608721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83aa91-06e0-47bc-8158-c3d646948697 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:28.609527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83aa91-06e0-47bc-8158-c3d646948697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:28.614944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b1247-671e-46f4-8e38-28d0f92914b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:28.616364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1247-671e-46f4-8e38-28d0f92914b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:28.616364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1247-671e-46f4-8e38-28d0f92914b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:28.618482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1247-671e-46f4-8e38-28d0f92914b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:28.618482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b1247-671e-46f4-8e38-28d0f92914b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:28.625302 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b1247-671e-46f4-8e38-28d0f92914b2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:28.650729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 831/1669] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 541 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:28.650729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269725-0201-4dad-8f87-ef064fb1f594 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:28.650729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269725-0201-4dad-8f87-ef064fb1f594 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:28.650729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269725-0201-4dad-8f87-ef064fb1f594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:28.676330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fb83aa91-06e0-47bc-8158-c3d646948697 None None] MFA Rules not processed for user `a51ee88d16004507aa9d199782ced8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:28.678414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fb83aa91-06e0-47bc-8158-c3d646948697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:28.718304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9f269725-0201-4dad-8f87-ef064fb1f594 None None] MFA Rules not processed for user `2e9410daf1b242f8ba5ed06e8d4556d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:28.719575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9f269725-0201-4dad-8f87-ef064fb1f594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:28.723044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:28.811470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:28.839905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 839/1670] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:28.844965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83aa91-06e0-47bc-8158-c3d646948697 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:28.846683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fb83aa91-06e0-47bc-8158-c3d646948697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:28.887215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83aa91-06e0-47bc-8158-c3d646948697 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:28.898532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:28.899370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:28.899654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:28.900438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] PATH_INFO: `/v3/projects/e643138e3c234990807defb6f77d882b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:28.901612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e643138e3c234990807defb6f77d882b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:28.903704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:28.979382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 832/1671] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:28.980596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269725-0201-4dad-8f87-ef064fb1f594 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:28.985597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9f269725-0201-4dad-8f87-ef064fb1f594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:29.015183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269725-0201-4dad-8f87-ef064fb1f594 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:29.040882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e024a-4839-4f30-aab8-0ac4f45f2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:29.041934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e024a-4839-4f30-aab8-0ac4f45f2276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:29.042431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e024a-4839-4f30-aab8-0ac4f45f2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:29.042938 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e024a-4839-4f30-aab8-0ac4f45f2276 admin admin] PATH_INFO: `/v3/projects/6825f27b1c7b471c8f9ae2d5f0fec1fd/users/3788cf4ade9e4adbadeb9dab29853495/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:29.055205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e024a-4839-4f30-aab8-0ac4f45f2276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6825f27b1c7b471c8f9ae2d5f0fec1fd, user_id=3788cf4ade9e4adbadeb9dab29853495, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:29.059230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e024a-4839-4f30-aab8-0ac4f45f2276 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:29.072523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e643138e3c234990807defb6f77d882b', 'request_id': 'req-927203cd-c06d-4021-b7ed-8e19219ff0f9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:29.091516 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 833/1672] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:28 2022] PUT /identity/v3/projects/6825f27b1c7b471c8f9ae2d5f0fec1fd/users/3788cf4ade9e4adbadeb9dab29853495/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:29.094585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e643138e3c234990807defb6f77d882b', 'request_id': 'req-927203cd-c06d-4021-b7ed-8e19219ff0f9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:29.102373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e024a-4839-4f30-aab8-0ac4f45f2276 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:29.107596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bb0e024a-4839-4f30-aab8-0ac4f45f2276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:29.212052 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e643138e3c234990807defb6f77d882b', 'request_id': 'req-927203cd-c06d-4021-b7ed-8e19219ff0f9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:29.239931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] The token cache is being invalidate because project e643138e3c234990807defb6f77d882b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:29.240483 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:29.242018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:29.245950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 840/1673] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:28 2022] DELETE /identity/v3/projects/e643138e3c234990807defb6f77d882b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:29.251473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:29.261785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:29.281018 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e024a-4839-4f30-aab8-0ac4f45f2276 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:29.286143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1412b-c625-4909-b43a-8389afa577ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:29.286844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1412b-c625-4909-b43a-8389afa577ea service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:29.287128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1412b-c625-4909-b43a-8389afa577ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:29.287406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1412b-c625-4909-b43a-8389afa577ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:29.289727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-49b1412b-c625-4909-b43a-8389afa577ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:29.481493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1412b-c625-4909-b43a-8389afa577ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:29.490092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1412b-c625-4909-b43a-8389afa577ea service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:29.493769 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927203cd-c06d-4021-b7ed-8e19219ff0f9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:29.551109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 834/1674] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:29.552513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9dbb0-1383-4444-aa82-ed07efb15e52 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:29.560137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9dbb0-1383-4444-aa82-ed07efb15e52 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:29.560462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9dbb0-1383-4444-aa82-ed07efb15e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:29.615443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:29.616276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-35a9dbb0-1383-4444-aa82-ed07efb15e52 None None] MFA Rules not processed for user `2e9410daf1b242f8ba5ed06e8d4556d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:29.617523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-35a9dbb0-1383-4444-aa82-ed07efb15e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:29.711659 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9a7a-8a49-4909-95b1-32f8b36dffe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:29.720870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9a7a-8a49-4909-95b1-32f8b36dffe6 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:29.721629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9a7a-8a49-4909-95b1-32f8b36dffe6 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:29.722358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9a7a-8a49-4909-95b1-32f8b36dffe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:29.726470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-916a9a7a-8a49-4909-95b1-32f8b36dffe6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:29.826037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 835/1675] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:29.843733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07e78e-bb01-4d6b-80a8-729aea217889 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:29.845410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07e78e-bb01-4d6b-80a8-729aea217889 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:29.845741 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07e78e-bb01-4d6b-80a8-729aea217889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:29.875775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:29.931807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5f07e78e-bb01-4d6b-80a8-729aea217889 None None] MFA Rules not processed for user `7699159c5e67464ba6b82ec848c24439`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:29.931894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a9a7a-8a49-4909-95b1-32f8b36dffe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:29.932093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a9a7a-8a49-4909-95b1-32f8b36dffe6 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:29.932887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f07e78e-bb01-4d6b-80a8-729aea217889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:29.966944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 841/1676] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:29.970347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697d18-da97-4cee-96f6-334dbd63a053 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:29.970632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697d18-da97-4cee-96f6-334dbd63a053 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:29.971487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697d18-da97-4cee-96f6-334dbd63a053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:30.034138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d6697d18-da97-4cee-96f6-334dbd63a053 None None] MFA Rules not processed for user `3788cf4ade9e4adbadeb9dab29853495`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:30.035886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d6697d18-da97-4cee-96f6-334dbd63a053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:30.117455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 836/1677] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:30.128118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff71e2-5d2b-4370-876b-7c42ae66ae50 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:30.128118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff71e2-5d2b-4370-876b-7c42ae66ae50 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:30.128428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff71e2-5d2b-4370-876b-7c42ae66ae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:30.191283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5eff71e2-5d2b-4370-876b-7c42ae66ae50 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:30.192566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5eff71e2-5d2b-4370-876b-7c42ae66ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:30.258377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 837/1678] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:30.268913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1608a2c-db6d-43d1-a589-86efca051982 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:30.269973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1608a2c-db6d-43d1-a589-86efca051982 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:30.273316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1608a2c-db6d-43d1-a589-86efca051982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:30.313976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 842/1679] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:30.324619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6697d18-da97-4cee-96f6-334dbd63a053 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:30.329353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d6697d18-da97-4cee-96f6-334dbd63a053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:30.362291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b1608a2c-db6d-43d1-a589-86efca051982 None None] MFA Rules not processed for user `b66719801f8e4c56a7fc0208704d538f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:30.363859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b1608a2c-db6d-43d1-a589-86efca051982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:30.389901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6697d18-da97-4cee-96f6-334dbd63a053 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:30.408967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cebde9-d29c-481a-a37a-7d90d7a750ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:30.411557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cebde9-d29c-481a-a37a-7d90d7a750ce service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:30.411845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cebde9-d29c-481a-a37a-7d90d7a750ce service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:30.412310 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cebde9-d29c-481a-a37a-7d90d7a750ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:30.419415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a8cebde9-d29c-481a-a37a-7d90d7a750ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:30.450049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cebde9-d29c-481a-a37a-7d90d7a750ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:30.461999 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cebde9-d29c-481a-a37a-7d90d7a750ce service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:30.488039 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 843/1680] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:30.495170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe6ec-56b0-489c-a9dc-22b49e171d61 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:30.495464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe6ec-56b0-489c-a9dc-22b49e171d61 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:30.495746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe6ec-56b0-489c-a9dc-22b49e171d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:30.554643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 838/1681] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:30.555612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1608a2c-db6d-43d1-a589-86efca051982 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:30.564682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b1608a2c-db6d-43d1-a589-86efca051982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:30.618577 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-91cfe6ec-56b0-489c-a9dc-22b49e171d61 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:30.619731 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-91cfe6ec-56b0-489c-a9dc-22b49e171d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:30.653396 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 844/1682] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:30.657582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfe6ec-56b0-489c-a9dc-22b49e171d61 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:30.705314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfe6ec-56b0-489c-a9dc-22b49e171d61 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:30.734142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374ed68-bc98-4c67-982b-ea37dbcd125c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:30.734142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374ed68-bc98-4c67-982b-ea37dbcd125c service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:30.734142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374ed68-bc98-4c67-982b-ea37dbcd125c service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:30.734142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374ed68-bc98-4c67-982b-ea37dbcd125c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:30.773613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374ed68-bc98-4c67-982b-ea37dbcd125c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:30.775278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374ed68-bc98-4c67-982b-ea37dbcd125c service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:30.818524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1608a2c-db6d-43d1-a589-86efca051982 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:30.819950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 845/1683] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:30.834222 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374ed68-bc98-4c67-982b-ea37dbcd125c service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:30.844541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2384-3799-4226-9341-6d3d8e5e169f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:30.849947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2384-3799-4226-9341-6d3d8e5e169f service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:30.849947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2384-3799-4226-9341-6d3d8e5e169f service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:30.849947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2384-3799-4226-9341-6d3d8e5e169f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:30.865044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374ed68-bc98-4c67-982b-ea37dbcd125c service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:30.884500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8561f4-87ab-4d9f-801e-a9bf6f8ae6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:30.885767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8561f4-87ab-4d9f-801e-a9bf6f8ae6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:30.886061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8561f4-87ab-4d9f-801e-a9bf6f8ae6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:30.886341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8561f4-87ab-4d9f-801e-a9bf6f8ae6e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:30.887028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8561f4-87ab-4d9f-801e-a9bf6f8ae6e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:30.887339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8561f4-87ab-4d9f-801e-a9bf6f8ae6e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:30.888077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df2384-3799-4226-9341-6d3d8e5e169f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:30.895053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df2384-3799-4226-9341-6d3d8e5e169f service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:30.895738 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8561f4-87ab-4d9f-801e-a9bf6f8ae6e9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:30.924351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 846/1684] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:30.926042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 839/1685] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:30.937101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8561f4-87ab-4d9f-801e-a9bf6f8ae6e9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:30.951519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8561f4-87ab-4d9f-801e-a9bf6f8ae6e9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:30.961574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f1e4-d103-4fcb-8e33-31b08ae7bd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:30.961574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f1e4-d103-4fcb-8e33-31b08ae7bd8f admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:30.961574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f1e4-d103-4fcb-8e33-31b08ae7bd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:30.961574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8f1e4-d103-4fcb-8e33-31b08ae7bd8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:30.963156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8f1e4-d103-4fcb-8e33-31b08ae7bd8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:30.965647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8f1e4-d103-4fcb-8e33-31b08ae7bd8f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:30.985632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:30.996907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2384-3799-4226-9341-6d3d8e5e169f service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:30.998505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-02df2384-3799-4226-9341-6d3d8e5e169f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:31.034471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df2384-3799-4226-9341-6d3d8e5e169f service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:31.040373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:31.041700 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:31.042037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:31.042387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] PATH_INFO: `/v3/projects/782a5a97d0f14212b35b22821c61ca85` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:31.044245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=782a5a97d0f14212b35b22821c61ca85)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:31.047598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:31.071642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:31.137781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 847/1686] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:30 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:31.139643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f1e4-d103-4fcb-8e33-31b08ae7bd8f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:31.256859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782a5a97d0f14212b35b22821c61ca85', 'request_id': 'req-e506123f-52b6-4d92-adbd-479607f11876'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:31.288934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782a5a97d0f14212b35b22821c61ca85', 'request_id': 'req-e506123f-52b6-4d92-adbd-479607f11876'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:31.308946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782a5a97d0f14212b35b22821c61ca85', 'request_id': 'req-e506123f-52b6-4d92-adbd-479607f11876'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:31.417384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8f1e4-d103-4fcb-8e33-31b08ae7bd8f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:31.444415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] The token cache is being invalidate because project 782a5a97d0f14212b35b22821c61ca85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:31.444415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:31.446447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:31.453477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 840/1687] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:30 2022] DELETE /identity/v3/projects/782a5a97d0f14212b35b22821c61ca85 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:31.459419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:31.466234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:31.648134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506123f-52b6-4d92-adbd-479607f11876 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:31.649570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176b92-abe3-404f-af9d-dc2125e7c95c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:31.652204 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176b92-abe3-404f-af9d-dc2125e7c95c service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:31.654770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176b92-abe3-404f-af9d-dc2125e7c95c service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:31.655117 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176b92-abe3-404f-af9d-dc2125e7c95c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:31.663570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7a73d-e6c3-4eaf-a184-3c9f976faa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:31.663781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-06176b92-abe3-404f-af9d-dc2125e7c95c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:31.664296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7a73d-e6c3-4eaf-a184-3c9f976faa82 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:31.664520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7a73d-e6c3-4eaf-a184-3c9f976faa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:31.664790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7a73d-e6c3-4eaf-a184-3c9f976faa82 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:31.665439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7a73d-e6c3-4eaf-a184-3c9f976faa82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:31.669095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7a73d-e6c3-4eaf-a184-3c9f976faa82 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:31.787417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06176b92-abe3-404f-af9d-dc2125e7c95c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:31.802502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06176b92-abe3-404f-af9d-dc2125e7c95c service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:31.825132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 848/1688] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:31.826350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176b92-abe3-404f-af9d-dc2125e7c95c service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:31.837172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 841/1689] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:31 2022] POST /identity/v3/users => generated 289 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:31.838732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5881a29-5356-48a2-829b-c580c2199376 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:31.839044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5881a29-5356-48a2-829b-c580c2199376 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:31.840775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5881a29-5356-48a2-829b-c580c2199376 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:31.845321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-06176b92-abe3-404f-af9d-dc2125e7c95c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:31.847740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 842/1690] 10.222.0.18 () {54 vars in 912 bytes} [Thu Sep 1 12:19:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:19:31.849443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5881a29-5356-48a2-829b-c580c2199376 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:31.884146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176b92-abe3-404f-af9d-dc2125e7c95c service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:31.889648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5881a29-5356-48a2-829b-c580c2199376 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:31.894375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:31.895534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:31.896395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:31.896861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] PATH_INFO: `/v3/users/e44ce6450fef4704b6306bee79a9bd64` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:31.898589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44ce6450fef4704b6306bee79a9bd64)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:31.900422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc4e3d-60ca-4e50-9da4-87a8b2abe2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:31.901076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc4e3d-60ca-4e50-9da4-87a8b2abe2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:31.905455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc4e3d-60ca-4e50-9da4-87a8b2abe2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:31.905586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:31.905664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc4e3d-60ca-4e50-9da4-87a8b2abe2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:31.905664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc4e3d-60ca-4e50-9da4-87a8b2abe2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:31.907810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc4e3d-60ca-4e50-9da4-87a8b2abe2c2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:31.933087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 843/1691] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:31.934410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66548279-0e17-48b7-ad7f-bc4a6f14d15f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:31.934696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66548279-0e17-48b7-ad7f-bc4a6f14d15f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:31.934980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66548279-0e17-48b7-ad7f-bc4a6f14d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:31.940729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:32.013983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-66548279-0e17-48b7-ad7f-bc4a6f14d15f None None] MFA Rules not processed for user `d0eb27228bae4b6d97715c0c46032030`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:32.013983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-66548279-0e17-48b7-ad7f-bc4a6f14d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:32.101506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 844/1692] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:19:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:32.102515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66548279-0e17-48b7-ad7f-bc4a6f14d15f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:32.118741 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66548279-0e17-48b7-ad7f-bc4a6f14d15f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:32.126178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30479-4b82-490d-a833-fddd0f8b86ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:32.127239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30479-4b82-490d-a833-fddd0f8b86ae admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:32.127533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30479-4b82-490d-a833-fddd0f8b86ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:32.129073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30479-4b82-490d-a833-fddd0f8b86ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:32.129073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e30479-4b82-490d-a833-fddd0f8b86ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:32.130452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e30479-4b82-490d-a833-fddd0f8b86ae admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:32.145673 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 845/1693] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:32.146656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30479-4b82-490d-a833-fddd0f8b86ae admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:32.148456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-81e30479-4b82-490d-a833-fddd0f8b86ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:32.174375 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30479-4b82-490d-a833-fddd0f8b86ae admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:32.180449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9892b7-2da9-4e7b-90c1-a858afbbe3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:32.181310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9892b7-2da9-4e7b-90c1-a858afbbe3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:32.181887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9892b7-2da9-4e7b-90c1-a858afbbe3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:32.182217 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9892b7-2da9-4e7b-90c1-a858afbbe3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:32.189510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:32.190687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44ce6450fef4704b6306bee79a9bd64'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:32.206065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9892b7-2da9-4e7b-90c1-a858afbbe3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:32.206227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44ce6450fef4704b6306bee79a9bd64'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:32.207437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44ce6450fef4704b6306bee79a9bd64'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:32.207646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9892b7-2da9-4e7b-90c1-a858afbbe3b3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:32.231613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 846/1694] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:32.232702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9892b7-2da9-4e7b-90c1-a858afbbe3b3 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:32.261185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9892b7-2da9-4e7b-90c1-a858afbbe3b3 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:32.279392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c8f71-c440-45c2-86ed-c296893c7c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:32.280197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c8f71-c440-45c2-86ed-c296893c7c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:32.280506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c8f71-c440-45c2-86ed-c296893c7c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:32.280806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c8f71-c440-45c2-86ed-c296893c7c6b admin admin] PATH_INFO: `/v3/projects/4b6c3d6094ee4678a4d0090ae9c3f75e/users/829230375d4e489bbb9c03904db4fa2d/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:32.314594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c8f71-c440-45c2-86ed-c296893c7c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6c3d6094ee4678a4d0090ae9c3f75e, user_id=829230375d4e489bbb9c03904db4fa2d, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:32.317455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c8f71-c440-45c2-86ed-c296893c7c6b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:32.321854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44ce6450fef4704b6306bee79a9bd64'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:32.364523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1024abce-db9f-43be-bb2d-312bd48b9bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44ce6450fef4704b6306bee79a9bd64'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:32.378438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 849/1695] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:31 2022] DELETE /identity/v3/users/e44ce6450fef4704b6306bee79a9bd64 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:32.412298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 847/1696] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:32 2022] PUT /identity/v3/projects/4b6c3d6094ee4678a4d0090ae9c3f75e/users/829230375d4e489bbb9c03904db4fa2d/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:32.425311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35e874-241d-4bf1-89e2-e2a06701f958 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:32.426049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35e874-241d-4bf1-89e2-e2a06701f958 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:32.426475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35e874-241d-4bf1-89e2-e2a06701f958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:32.494728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1b35e874-241d-4bf1-89e2-e2a06701f958 None None] MFA Rules not processed for user `829230375d4e489bbb9c03904db4fa2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:32.497257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1b35e874-241d-4bf1-89e2-e2a06701f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:32.663399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 850/1697] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:32.676036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c8f71-c440-45c2-86ed-c296893c7c6b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:32.678428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8f6c8f71-c440-45c2-86ed-c296893c7c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:32.846925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c8f71-c440-45c2-86ed-c296893c7c6b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:32.863892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d5154-1dca-4632-9c5e-0da1e5095103 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b84587baf0432c800a6278d7095cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:32.865293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5154-1dca-4632-9c5e-0da1e5095103 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:32.865906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5154-1dca-4632-9c5e-0da1e5095103 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:32.877587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5154-1dca-4632-9c5e-0da1e5095103 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:32.887522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d5154-1dca-4632-9c5e-0da1e5095103 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:32.890426 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d5154-1dca-4632-9c5e-0da1e5095103 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:32.917014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 848/1698] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:33.562880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35e874-241d-4bf1-89e2-e2a06701f958 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:33.564987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1b35e874-241d-4bf1-89e2-e2a06701f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:33.692761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fec6e-cb6e-40c0-ae5c-df15598b6aa2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:33.693252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fec6e-cb6e-40c0-ae5c-df15598b6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:33.695638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fec6e-cb6e-40c0-ae5c-df15598b6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:33.745897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35e874-241d-4bf1-89e2-e2a06701f958 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:33.753930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cd1fec6e-cb6e-40c0-ae5c-df15598b6aa2 None None] MFA Rules not processed for user `2e9410daf1b242f8ba5ed06e8d4556d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:33.754778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc61d49-93f5-4841-a732-7fc928cd3cdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:33.755418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61d49-93f5-4841-a732-7fc928cd3cdd service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:33.755710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61d49-93f5-4841-a732-7fc928cd3cdd service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:33.756151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61d49-93f5-4841-a732-7fc928cd3cdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:33.756523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cd1fec6e-cb6e-40c0-ae5c-df15598b6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:33.758218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1bc61d49-93f5-4841-a732-7fc928cd3cdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:33.773813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc61d49-93f5-4841-a732-7fc928cd3cdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:33.775737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc61d49-93f5-4841-a732-7fc928cd3cdd service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:33.789634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 851/1699] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:33.956760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 849/1700] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:19:34.051292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fdeef-d7ba-44f2-8772-369ea7b19f0f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:34.052546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fdeef-d7ba-44f2-8772-369ea7b19f0f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:34.053122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fdeef-d7ba-44f2-8772-369ea7b19f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:34.159403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-193fdeef-d7ba-44f2-8772-369ea7b19f0f None None] MFA Rules not processed for user `cf491a01dea94a2f93a40324c94d2612`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:34.161703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-193fdeef-d7ba-44f2-8772-369ea7b19f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:34.171141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:34.340569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 852/1701] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:34.353088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6e4c3-0325-4b61-8cb8-d57d2c5a7db0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:34.353378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6e4c3-0325-4b61-8cb8-d57d2c5a7db0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:34.353654 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6e4c3-0325-4b61-8cb8-d57d2c5a7db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:34.393233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c3d6e4c3-0325-4b61-8cb8-d57d2c5a7db0 None None] MFA Rules not processed for user `cf491a01dea94a2f93a40324c94d2612`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:34.397629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c3d6e4c3-0325-4b61-8cb8-d57d2c5a7db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:34.434194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 850/1702] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:34.447078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fdeef-d7ba-44f2-8772-369ea7b19f0f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:34.448970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-193fdeef-d7ba-44f2-8772-369ea7b19f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:34.636746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fdeef-d7ba-44f2-8772-369ea7b19f0f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:34.671189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11db01-dd92-471f-afc6-3705fb439f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:34.676777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11db01-dd92-471f-afc6-3705fb439f7c service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:34.679935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11db01-dd92-471f-afc6-3705fb439f7c service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:34.680074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11db01-dd92-471f-afc6-3705fb439f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:34.716857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11db01-dd92-471f-afc6-3705fb439f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:34.719227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11db01-dd92-471f-afc6-3705fb439f7c service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:34.742190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 853/1703] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:35.155390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6e4c3-0325-4b61-8cb8-d57d2c5a7db0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:35.156962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c3d6e4c3-0325-4b61-8cb8-d57d2c5a7db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:35.247357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:35.308177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6e4c3-0325-4b61-8cb8-d57d2c5a7db0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:35.320381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:35.321287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:35.321719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:35.322840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] PATH_INFO: `/v3/projects/a319dd79a1884e85b7817d3566d99107` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:35.324245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a319dd79a1884e85b7817d3566d99107)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:35.326380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:35.550861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b847e-aed5-4ec1-874a-65041a927d33 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:35.551156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b847e-aed5-4ec1-874a-65041a927d33 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:35.551515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b847e-aed5-4ec1-874a-65041a927d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:35.658246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a319dd79a1884e85b7817d3566d99107', 'request_id': 'req-69a5c921-fdc8-422f-a9a3-1a861bb4715a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:35.684305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a319dd79a1884e85b7817d3566d99107', 'request_id': 'req-69a5c921-fdc8-422f-a9a3-1a861bb4715a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:35.712393 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a319dd79a1884e85b7817d3566d99107', 'request_id': 'req-69a5c921-fdc8-422f-a9a3-1a861bb4715a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:35.737140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b03b847e-aed5-4ec1-874a-65041a927d33 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:35.738787 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b03b847e-aed5-4ec1-874a-65041a927d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:35.790259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] The token cache is being invalidate because project a319dd79a1884e85b7817d3566d99107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:35.792594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:35.794818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69a5c921-fdc8-422f-a9a3-1a861bb4715a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:35.799309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 851/1704] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:35 2022] DELETE /identity/v3/projects/a319dd79a1884e85b7817d3566d99107 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:35.806759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d649f6c-d08e-4a8e-86e4-5ae083911c33 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:35.807271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d649f6c-d08e-4a8e-86e4-5ae083911c33 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:35.808324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d649f6c-d08e-4a8e-86e4-5ae083911c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:35.885541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4d649f6c-d08e-4a8e-86e4-5ae083911c33 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:35.887975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4d649f6c-d08e-4a8e-86e4-5ae083911c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:35.916187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 854/1705] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:19:36.062921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 852/1706] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:36.071964 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e4014-4aad-46c0-a655-a17ba4ce2225 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:36.072281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e4014-4aad-46c0-a655-a17ba4ce2225 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:36.072563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e4014-4aad-46c0-a655-a17ba4ce2225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:36.128167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-208e4014-4aad-46c0-a655-a17ba4ce2225 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:36.131152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-208e4014-4aad-46c0-a655-a17ba4ce2225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:36.135578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d649f6c-d08e-4a8e-86e4-5ae083911c33 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:36.139031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4d649f6c-d08e-4a8e-86e4-5ae083911c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:36.166268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 855/1707] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:36.170137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e4014-4aad-46c0-a655-a17ba4ce2225 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:36.176833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d649f6c-d08e-4a8e-86e4-5ae083911c33 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:36.183973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e4014-4aad-46c0-a655-a17ba4ce2225 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:36.188427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:36.190347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:36.191243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:36.192816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] PATH_INFO: `/v3/users/33b254a1edbc4221b174899ead70cb43` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:36.195945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c07b8-7714-4973-bec7-74d34af23205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:36.196632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c07b8-7714-4973-bec7-74d34af23205 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:36.196914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c07b8-7714-4973-bec7-74d34af23205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:36.197190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c07b8-7714-4973-bec7-74d34af23205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:36.197543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b254a1edbc4221b174899ead70cb43)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:36.197854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c07b8-7714-4973-bec7-74d34af23205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:36.198158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c07b8-7714-4973-bec7-74d34af23205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:36.199800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c07b8-7714-4973-bec7-74d34af23205 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:36.201713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:36.236303 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 856/1708] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:19:36.241551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c07b8-7714-4973-bec7-74d34af23205 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:36.255756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c07b8-7714-4973-bec7-74d34af23205 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:36.278774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496caa5-28c3-417c-a120-15f96b57bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:36.279745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496caa5-28c3-417c-a120-15f96b57bf84 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:36.280785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496caa5-28c3-417c-a120-15f96b57bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:36.281711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496caa5-28c3-417c-a120-15f96b57bf84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:36.282608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496caa5-28c3-417c-a120-15f96b57bf84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:36.285433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496caa5-28c3-417c-a120-15f96b57bf84 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:36.385725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 857/1709] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:36 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:36.387127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86413ee5-d9ca-4754-b3bc-39dac825daf1 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:36.387427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86413ee5-d9ca-4754-b3bc-39dac825daf1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:36.387707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86413ee5-d9ca-4754-b3bc-39dac825daf1 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:36.392275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 858/1710] 10.222.0.18 () {54 vars in 912 bytes} [Thu Sep 1 12:19:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:19:36.393176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86413ee5-d9ca-4754-b3bc-39dac825daf1 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:36.549646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b254a1edbc4221b174899ead70cb43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:36.559381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b254a1edbc4221b174899ead70cb43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:36.618945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86413ee5-d9ca-4754-b3bc-39dac825daf1 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:36.649885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23297c30-5828-4293-8043-50a91d29e4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:36.650529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23297c30-5828-4293-8043-50a91d29e4ef admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:36.650813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23297c30-5828-4293-8043-50a91d29e4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:36.651087 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23297c30-5828-4293-8043-50a91d29e4ef admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:36.651737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23297c30-5828-4293-8043-50a91d29e4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:36.653952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23297c30-5828-4293-8043-50a91d29e4ef admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:36.667548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b254a1edbc4221b174899ead70cb43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:36.670150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b254a1edbc4221b174899ead70cb43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:36.672164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-558fd515-643d-4191-9018-ce249319f676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b254a1edbc4221b174899ead70cb43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:36.755681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 853/1711] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:36 2022] DELETE /identity/v3/users/33b254a1edbc4221b174899ead70cb43 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:19:36.757500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89df92-1182-4366-ab55-f4fc81106540 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:36.758969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89df92-1182-4366-ab55-f4fc81106540 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:36.759405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89df92-1182-4366-ab55-f4fc81106540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:36.783532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 859/1712] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:36 2022] POST /identity/v3/users => generated 283 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:36.785058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23297c30-5828-4293-8043-50a91d29e4ef admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:36.789607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8d89df92-1182-4366-ab55-f4fc81106540 None None] MFA Rules not processed for user `d0eb27228bae4b6d97715c0c46032030`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:36.790355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-23297c30-5828-4293-8043-50a91d29e4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:36.791010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8d89df92-1182-4366-ab55-f4fc81106540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:36.941962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 854/1713] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:36.943499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f05d-dbae-4eed-9787-9f84ae72015f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:36.944051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f05d-dbae-4eed-9787-9f84ae72015f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:36.944560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f05d-dbae-4eed-9787-9f84ae72015f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:36.972963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-57a1f05d-dbae-4eed-9787-9f84ae72015f None None] MFA Rules not processed for user `a51ee88d16004507aa9d199782ced8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:36.974736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-57a1f05d-dbae-4eed-9787-9f84ae72015f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:37.024267 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23297c30-5828-4293-8043-50a91d29e4ef admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:37.127614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 855/1714] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:37.130462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6abfb-7bda-4eb0-ba5d-07c21e0bb959 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:37.132346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6abfb-7bda-4eb0-ba5d-07c21e0bb959 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:37.132807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6abfb-7bda-4eb0-ba5d-07c21e0bb959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:37.173441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b9e6abfb-7bda-4eb0-ba5d-07c21e0bb959 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:37.175176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b9e6abfb-7bda-4eb0-ba5d-07c21e0bb959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:37.182262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbe38f-155b-4c76-bd52-477a63bc7620 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:37.182892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe38f-155b-4c76-bd52-477a63bc7620 service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:37.183332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe38f-155b-4c76-bd52-477a63bc7620 service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:37.188554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbe38f-155b-4c76-bd52-477a63bc7620 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:37.197518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-73dbe38f-155b-4c76-bd52-477a63bc7620 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:37.304266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:37.352727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:37.359636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 856/1715] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:37.359636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6abfb-7bda-4eb0-ba5d-07c21e0bb959 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:37.365860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b9e6abfb-7bda-4eb0-ba5d-07c21e0bb959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:37.367967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbe38f-155b-4c76-bd52-477a63bc7620 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:37.369627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbe38f-155b-4c76-bd52-477a63bc7620 service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:37.384956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6abfb-7bda-4eb0-ba5d-07c21e0bb959 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:37.386924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 860/1716] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:19:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:19:37.387982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbe38f-155b-4c76-bd52-477a63bc7620 service swift] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:37.398089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-73dbe38f-155b-4c76-bd52-477a63bc7620 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:37.401058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd6937-1c5d-4c74-b61b-8b10e110b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:37.402093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6937-1c5d-4c74-b61b-8b10e110b192 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:37.402555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6937-1c5d-4c74-b61b-8b10e110b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:37.402930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6937-1c5d-4c74-b61b-8b10e110b192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:37.403786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd6937-1c5d-4c74-b61b-8b10e110b192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:37.412738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd6937-1c5d-4c74-b61b-8b10e110b192 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:37.425605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbe38f-155b-4c76-bd52-477a63bc7620 service swift] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:37.431680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 857/1717] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:37.432982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00427402-2b15-4640-af71-85d4e85eda9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:37.433312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd6937-1c5d-4c74-b61b-8b10e110b192 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:37.433634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00427402-2b15-4640-af71-85d4e85eda9d service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:37.433947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00427402-2b15-4640-af71-85d4e85eda9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:37.434256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00427402-2b15-4640-af71-85d4e85eda9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:37.436743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1cfd6937-1c5d-4c74-b61b-8b10e110b192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:37.451646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00427402-2b15-4640-af71-85d4e85eda9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:37.452570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00427402-2b15-4640-af71-85d4e85eda9d service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:37.453761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd6937-1c5d-4c74-b61b-8b10e110b192 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:37.459007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ccb57-8995-49ce-8a17-6a4d199bc9a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:37.460120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ccb57-8995-49ce-8a17-6a4d199bc9a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:37.460926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ccb57-8995-49ce-8a17-6a4d199bc9a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:37.461589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ccb57-8995-49ce-8a17-6a4d199bc9a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:37.475150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ccb57-8995-49ce-8a17-6a4d199bc9a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:37.477833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ccb57-8995-49ce-8a17-6a4d199bc9a2 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:37.480613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 861/1718] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:37.481624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00427402-2b15-4640-af71-85d4e85eda9d service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:37.494304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00427402-2b15-4640-af71-85d4e85eda9d service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:37.502601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 858/1719] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:37.508908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dc851-cb0b-430e-9c0b-9981d2c87665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:37.515011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dc851-cb0b-430e-9c0b-9981d2c87665 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:37.515011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dc851-cb0b-430e-9c0b-9981d2c87665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:37.515011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dc851-cb0b-430e-9c0b-9981d2c87665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:37.515011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dc851-cb0b-430e-9c0b-9981d2c87665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:37.515011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dc851-cb0b-430e-9c0b-9981d2c87665 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:37.538796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 862/1720] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:37.543270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ccb57-8995-49ce-8a17-6a4d199bc9a2 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:37.560799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ccb57-8995-49ce-8a17-6a4d199bc9a2 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:37.593037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e38dcb-1f08-404d-9cf4-ff2c14948769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:37.593037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e38dcb-1f08-404d-9cf4-ff2c14948769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:37.593037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e38dcb-1f08-404d-9cf4-ff2c14948769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:37.593037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e38dcb-1f08-404d-9cf4-ff2c14948769 admin admin] PATH_INFO: `/v3/projects/72d0d6f5d2434903bfc3070f38960d4c/users/58ccceec02be456c9d1723295ba64dc1/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:37.638947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e38dcb-1f08-404d-9cf4-ff2c14948769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d0d6f5d2434903bfc3070f38960d4c, user_id=58ccceec02be456c9d1723295ba64dc1, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:37.656190 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e38dcb-1f08-404d-9cf4-ff2c14948769 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:37.749151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 859/1721] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:37 2022] PUT /identity/v3/projects/72d0d6f5d2434903bfc3070f38960d4c/users/58ccceec02be456c9d1723295ba64dc1/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:37.759868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e48a-a381-48c4-8c49-97700bb2dbf0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:37.760155 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e48a-a381-48c4-8c49-97700bb2dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:37.760836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e48a-a381-48c4-8c49-97700bb2dbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:37.868101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6dc2e48a-a381-48c4-8c49-97700bb2dbf0 None None] MFA Rules not processed for user `58ccceec02be456c9d1723295ba64dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:37.869322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6dc2e48a-a381-48c4-8c49-97700bb2dbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:38.120269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e38dcb-1f08-404d-9cf4-ff2c14948769 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:38.123143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 863/1722] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:38.304510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:38.314442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e38dcb-1f08-404d-9cf4-ff2c14948769 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:38.328595 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddd6e2-f636-461a-b8a2-346b63b33687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:38.329591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddd6e2-f636-461a-b8a2-346b63b33687 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:38.330120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddd6e2-f636-461a-b8a2-346b63b33687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:38.330545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddd6e2-f636-461a-b8a2-346b63b33687 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:38.331361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddd6e2-f636-461a-b8a2-346b63b33687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:38.335969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddd6e2-f636-461a-b8a2-346b63b33687 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:38.472509 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 860/1723] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:38 2022] POST /identity/v3/projects => generated 363 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:19:38.476350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e48a-a381-48c4-8c49-97700bb2dbf0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:38.490675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e48a-a381-48c4-8c49-97700bb2dbf0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:38.529532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddd6e2-f636-461a-b8a2-346b63b33687 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:38.539589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82ddd6e2-f636-461a-b8a2-346b63b33687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:38.640616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed26e8-2ccf-49bc-b03a-18eca495827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:38.641269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed26e8-2ccf-49bc-b03a-18eca495827b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:38.641621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed26e8-2ccf-49bc-b03a-18eca495827b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:38.641897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed26e8-2ccf-49bc-b03a-18eca495827b admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:38.650637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed26e8-2ccf-49bc-b03a-18eca495827b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:38.658229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed26e8-2ccf-49bc-b03a-18eca495827b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:38.698939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddd6e2-f636-461a-b8a2-346b63b33687 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:38.707400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:38.708107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:38.708888 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:38.710188 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] PATH_INFO: `/v3/projects/03ccd949e43940a9b95c73f054536ed8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:38.712400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ccd949e43940a9b95c73f054536ed8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:38.714754 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:38.800265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 864/1724] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:38 2022] POST /identity/v3/users => generated 288 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:38.805949 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed26e8-2ccf-49bc-b03a-18eca495827b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:38.851861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed26e8-2ccf-49bc-b03a-18eca495827b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:38.891325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032717-737f-47b8-930b-d7bac32fcd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:38.893401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032717-737f-47b8-930b-d7bac32fcd3f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:38.893839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032717-737f-47b8-930b-d7bac32fcd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:38.894428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032717-737f-47b8-930b-d7bac32fcd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:38.895355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5032717-737f-47b8-930b-d7bac32fcd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:38.899909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5032717-737f-47b8-930b-d7bac32fcd3f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:38.900169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ccd949e43940a9b95c73f054536ed8', 'request_id': 'req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:38.927979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ccd949e43940a9b95c73f054536ed8', 'request_id': 'req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:38.942273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 865/1725] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:38.946989 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0302c0-a49d-457a-8b9a-48153c859f1e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:38.948726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0302c0-a49d-457a-8b9a-48153c859f1e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:38.949232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0302c0-a49d-457a-8b9a-48153c859f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:38.975264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fa0302c0-a49d-457a-8b9a-48153c859f1e None None] MFA Rules not processed for user `7699159c5e67464ba6b82ec848c24439`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:38.976704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fa0302c0-a49d-457a-8b9a-48153c859f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:38.987725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ccd949e43940a9b95c73f054536ed8', 'request_id': 'req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:39.121235 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] The token cache is being invalidate because project 03ccd949e43940a9b95c73f054536ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:39.121839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:39.123802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:39.125028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 866/1726] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:39.126186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0302c0-a49d-457a-8b9a-48153c859f1e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:39.129186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 861/1727] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:38 2022] DELETE /identity/v3/projects/03ccd949e43940a9b95c73f054536ed8 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:39.130410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:39.133123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:39.248227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0302c0-a49d-457a-8b9a-48153c859f1e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:39.254745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147abeb-3f54-40ab-8033-ece51845aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:39.267288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147abeb-3f54-40ab-8033-ece51845aa7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:39.267650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147abeb-3f54-40ab-8033-ece51845aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:39.268086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147abeb-3f54-40ab-8033-ece51845aa7d admin admin] PATH_INFO: `/v3/projects/09e4e05678744c288b66eabd1b0c43fa/users/08e5b90a371a4599a0d959dfed4a7342/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:39.343007 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147abeb-3f54-40ab-8033-ece51845aa7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e4e05678744c288b66eabd1b0c43fa, user_id=08e5b90a371a4599a0d959dfed4a7342, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:39.346460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147abeb-3f54-40ab-8033-ece51845aa7d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:39.367603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c7d9f-7a6b-45d2-af4b-8f6642deb8e5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:39.381504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:39.382523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:39.383001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:39.383677 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] PATH_INFO: `/v3/users/3788cf4ade9e4adbadeb9dab29853495` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:39.385635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3788cf4ade9e4adbadeb9dab29853495)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:39.390851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:39.581845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 867/1728] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:39 2022] PUT /identity/v3/projects/09e4e05678744c288b66eabd1b0c43fa/users/08e5b90a371a4599a0d959dfed4a7342/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:39.592004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147abeb-3f54-40ab-8033-ece51845aa7d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:39.604517 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9147abeb-3f54-40ab-8033-ece51845aa7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:39.885408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147abeb-3f54-40ab-8033-ece51845aa7d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:39.885408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555cec9-49eb-47fe-b32a-507304949ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:39.885408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555cec9-49eb-47fe-b32a-507304949ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:39.885408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555cec9-49eb-47fe-b32a-507304949ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:39.888677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555cec9-49eb-47fe-b32a-507304949ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:39.888677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555cec9-49eb-47fe-b32a-507304949ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:39.888677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555cec9-49eb-47fe-b32a-507304949ccb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:39.888677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 868/1729] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:39.888677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555cec9-49eb-47fe-b32a-507304949ccb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:39.888677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555cec9-49eb-47fe-b32a-507304949ccb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:39.895704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e01f56-77ff-4f6f-9c7d-ce5d19ca3d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:39.911445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e01f56-77ff-4f6f-9c7d-ce5d19ca3d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:39.911445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e01f56-77ff-4f6f-9c7d-ce5d19ca3d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:39.911445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e01f56-77ff-4f6f-9c7d-ce5d19ca3d63 admin admin] PATH_INFO: `/v3/projects/09e4e05678744c288b66eabd1b0c43fa/users/08e5b90a371a4599a0d959dfed4a7342/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:39.911445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e01f56-77ff-4f6f-9c7d-ce5d19ca3d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e4e05678744c288b66eabd1b0c43fa, user_id=08e5b90a371a4599a0d959dfed4a7342, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:39.911445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e01f56-77ff-4f6f-9c7d-ce5d19ca3d63 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:39.949982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 869/1730] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:39 2022] PUT /identity/v3/projects/09e4e05678744c288b66eabd1b0c43fa/users/08e5b90a371a4599a0d959dfed4a7342/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:39.961884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dac4aa-7651-4a38-89b7-b2c9b5091377 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:39.962178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dac4aa-7651-4a38-89b7-b2c9b5091377 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:39.962441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dac4aa-7651-4a38-89b7-b2c9b5091377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:40.027708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-51dac4aa-7651-4a38-89b7-b2c9b5091377 None None] MFA Rules not processed for user `08e5b90a371a4599a0d959dfed4a7342`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:40.031509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-51dac4aa-7651-4a38-89b7-b2c9b5091377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:40.253898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3788cf4ade9e4adbadeb9dab29853495'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:40.329842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3788cf4ade9e4adbadeb9dab29853495'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:40.364120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 870/1731] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:40.396503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dac4aa-7651-4a38-89b7-b2c9b5091377 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:40.399216 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-51dac4aa-7651-4a38-89b7-b2c9b5091377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:40.476243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3788cf4ade9e4adbadeb9dab29853495'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:40.477479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3788cf4ade9e4adbadeb9dab29853495'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:40.481550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b311dc42-f166-4e2e-933b-974850b11387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3788cf4ade9e4adbadeb9dab29853495'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:40.610348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dac4aa-7651-4a38-89b7-b2c9b5091377 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:40.617929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac35389-15e5-4a39-bf46-9698f029249c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:40.619220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac35389-15e5-4a39-bf46-9698f029249c service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:40.619876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac35389-15e5-4a39-bf46-9698f029249c service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:40.620522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac35389-15e5-4a39-bf46-9698f029249c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:40.625623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 862/1732] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:39 2022] DELETE /identity/v3/users/3788cf4ade9e4adbadeb9dab29853495 => generated 0 bytes in 1491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:40.627175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6ac35389-15e5-4a39-bf46-9698f029249c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:40.629274 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dec9d8-0bfb-4bfa-869e-d922713cddfe None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:40.630880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dec9d8-0bfb-4bfa-869e-d922713cddfe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:40.630880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dec9d8-0bfb-4bfa-869e-d922713cddfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:40.659696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac35389-15e5-4a39-bf46-9698f029249c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:40.660915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac35389-15e5-4a39-bf46-9698f029249c service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:40.680903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-85dec9d8-0bfb-4bfa-869e-d922713cddfe None None] MFA Rules not processed for user `b66719801f8e4c56a7fc0208704d538f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:40.683410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-85dec9d8-0bfb-4bfa-869e-d922713cddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:40.692841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 871/1733] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:40.789890 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:40.815053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 863/1734] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:40.875665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:41.003620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97f66-4b7b-4573-beb6-32bf97ac8e55 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:41.004186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97f66-4b7b-4573-beb6-32bf97ac8e55 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:41.004635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97f66-4b7b-4573-beb6-32bf97ac8e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:41.110414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-59f97f66-4b7b-4573-beb6-32bf97ac8e55 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:41.115239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-59f97f66-4b7b-4573-beb6-32bf97ac8e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:41.416646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dec9d8-0bfb-4bfa-869e-d922713cddfe None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:41.417212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:41.419092 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 872/1735] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:19:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:41.420108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-85dec9d8-0bfb-4bfa-869e-d922713cddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:41.583777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dec9d8-0bfb-4bfa-869e-d922713cddfe None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:41.589887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a107f07-b476-4472-99ac-8a2545105d2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:41.590519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a107f07-b476-4472-99ac-8a2545105d2a service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:41.590848 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a107f07-b476-4472-99ac-8a2545105d2a service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:41.591128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a107f07-b476-4472-99ac-8a2545105d2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:41.601695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a107f07-b476-4472-99ac-8a2545105d2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:41.603437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a107f07-b476-4472-99ac-8a2545105d2a service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:41.613386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 864/1736] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:19:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:19:42.149289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a453c32-5290-46fc-8df2-04511a9620fa None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:42.150389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a453c32-5290-46fc-8df2-04511a9620fa None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:42.150389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a453c32-5290-46fc-8df2-04511a9620fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:42.222987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9a453c32-5290-46fc-8df2-04511a9620fa None None] MFA Rules not processed for user `d0eb27228bae4b6d97715c0c46032030`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:42.224375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9a453c32-5290-46fc-8df2-04511a9620fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:42.259761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a107f07-b476-4472-99ac-8a2545105d2a service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:42.261312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4a107f07-b476-4472-99ac-8a2545105d2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:42.472460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 873/1737] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Sep 1 12:19:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:19:42.489824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a453c32-5290-46fc-8df2-04511a9620fa None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:42.492404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9a453c32-5290-46fc-8df2-04511a9620fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:42.548971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a453c32-5290-46fc-8df2-04511a9620fa None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:42.553045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a107f07-b476-4472-99ac-8a2545105d2a service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:42.575982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:42.578787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:42.583646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:42.584094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] PATH_INFO: `/v3/projects/6825f27b1c7b471c8f9ae2d5f0fec1fd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:42.586582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:42.587264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:42.587546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:42.587829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] PATH_INFO: `/v3/users/58ccceec02be456c9d1723295ba64dc1` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:42.588780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6825f27b1c7b471c8f9ae2d5f0fec1fd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:42.601302 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:42.606117 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ccceec02be456c9d1723295ba64dc1)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:42.608397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:42.822755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:42.871852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6825f27b1c7b471c8f9ae2d5f0fec1fd', 'request_id': 'req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:42.890004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6825f27b1c7b471c8f9ae2d5f0fec1fd', 'request_id': 'req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:42.910850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6825f27b1c7b471c8f9ae2d5f0fec1fd', 'request_id': 'req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:43.047328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] The token cache is being invalidate because project 6825f27b1c7b471c8f9ae2d5f0fec1fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:43.047780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:43.048693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:43.053353 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 865/1738] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:42 2022] DELETE /identity/v3/projects/6825f27b1c7b471c8f9ae2d5f0fec1fd => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:19:43.056007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:43.058737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:43.103093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ccceec02be456c9d1723295ba64dc1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:43.122455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ccceec02be456c9d1723295ba64dc1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:43.129276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ccceec02be456c9d1723295ba64dc1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:43.152521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:43.240784 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ccceec02be456c9d1723295ba64dc1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:43.285017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3cf7ad9b-d899-4cba-b2c0-85fa2bb91ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ccceec02be456c9d1723295ba64dc1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:43.329282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 874/1739] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:42 2022] DELETE /identity/v3/users/58ccceec02be456c9d1723295ba64dc1 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:43.331309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b260-5a1c-4bb9-a829-17f95a4c4cfb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:43.336256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b260-5a1c-4bb9-a829-17f95a4c4cfb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:43.336971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b260-5a1c-4bb9-a829-17f95a4c4cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:43.437302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-aa85b260-5a1c-4bb9-a829-17f95a4c4cfb None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:43.438890 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-aa85b260-5a1c-4bb9-a829-17f95a4c4cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:43.445408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63d1a7-d417-4e10-8c3d-6f7f4a0ef0c8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:43.588719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60ffc5-e537-4e4e-aa58-3ea8d254a900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:43.590322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60ffc5-e537-4e4e-aa58-3ea8d254a900 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:43.591212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60ffc5-e537-4e4e-aa58-3ea8d254a900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:43.591741 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60ffc5-e537-4e4e-aa58-3ea8d254a900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:43.597587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa60ffc5-e537-4e4e-aa58-3ea8d254a900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:43.658985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60ffc5-e537-4e4e-aa58-3ea8d254a900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:43.668106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60ffc5-e537-4e4e-aa58-3ea8d254a900 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:43.712099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 866/1740] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:43.719293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318665f-a978-4253-87da-a40b848f2948 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:43.724039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318665f-a978-4253-87da-a40b848f2948 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:43.726817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318665f-a978-4253-87da-a40b848f2948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:43.748695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 875/1741] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:43.755236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade59981-7927-4372-91e0-1061af9a5f04 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:43.755771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade59981-7927-4372-91e0-1061af9a5f04 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:43.756231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade59981-7927-4372-91e0-1061af9a5f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:43.791408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ade59981-7927-4372-91e0-1061af9a5f04 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:43.793008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ade59981-7927-4372-91e0-1061af9a5f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:43.804453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 876/1742] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:43.815207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade59981-7927-4372-91e0-1061af9a5f04 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:43.823690 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1318665f-a978-4253-87da-a40b848f2948 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:43.825300 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1318665f-a978-4253-87da-a40b848f2948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:43.832657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade59981-7927-4372-91e0-1061af9a5f04 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:43.844243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee5e16-1cd5-49ba-8c1b-d7750af6189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:43.847028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee5e16-1cd5-49ba-8c1b-d7750af6189d admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:43.847318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee5e16-1cd5-49ba-8c1b-d7750af6189d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:43.847607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee5e16-1cd5-49ba-8c1b-d7750af6189d admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:43.851164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee5e16-1cd5-49ba-8c1b-d7750af6189d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:43.851491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee5e16-1cd5-49ba-8c1b-d7750af6189d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:43.855036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee5e16-1cd5-49ba-8c1b-d7750af6189d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:43.862278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 867/1743] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:43.882708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 877/1744] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:43.893179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318665f-a978-4253-87da-a40b848f2948 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:43.898897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee5e16-1cd5-49ba-8c1b-d7750af6189d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:43.901008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2eee5e16-1cd5-49ba-8c1b-d7750af6189d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:43.914323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318665f-a978-4253-87da-a40b848f2948 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:43.938913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e38235-2c67-49a2-b816-b8f7d9c5b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:43.940008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e38235-2c67-49a2-b816-b8f7d9c5b5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:43.940734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e38235-2c67-49a2-b816-b8f7d9c5b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:43.942103 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee5e16-1cd5-49ba-8c1b-d7750af6189d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:43.942667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e38235-2c67-49a2-b816-b8f7d9c5b5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:43.943559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e38235-2c67-49a2-b816-b8f7d9c5b5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:43.946452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e38235-2c67-49a2-b816-b8f7d9c5b5f8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:43.954040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a0b73-d53f-4ead-a2b4-bccbd739b0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:43.959464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0b73-d53f-4ead-a2b4-bccbd739b0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:43.959464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0b73-d53f-4ead-a2b4-bccbd739b0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:43.959464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0b73-d53f-4ead-a2b4-bccbd739b0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:43.983675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a0b73-d53f-4ead-a2b4-bccbd739b0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:43.986734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a0b73-d53f-4ead-a2b4-bccbd739b0d3 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:44.015322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 878/1745] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:44.074052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 868/1746] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:43 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:44.074159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a0b73-d53f-4ead-a2b4-bccbd739b0d3 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:44.091926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a0b73-d53f-4ead-a2b4-bccbd739b0d3 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:44.281245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89a55f-b871-43ad-ab91-ce18ad403a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:44.281989 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89a55f-b871-43ad-ab91-ce18ad403a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:44.283886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89a55f-b871-43ad-ab91-ce18ad403a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:44.284628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89a55f-b871-43ad-ab91-ce18ad403a31 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:44.287470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89a55f-b871-43ad-ab91-ce18ad403a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:44.292939 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89a55f-b871-43ad-ab91-ce18ad403a31 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:44.337538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:44.425018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 879/1747] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:44 2022] POST /identity/v3/users => generated 290 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:19:44.429040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e38235-2c67-49a2-b816-b8f7d9c5b5f8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:44.444461 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e38235-2c67-49a2-b816-b8f7d9c5b5f8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:44.471222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2704f3-542b-4612-b003-44aa20d013d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:44.471861 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2704f3-542b-4612-b003-44aa20d013d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:44.472438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2704f3-542b-4612-b003-44aa20d013d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:44.472874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2704f3-542b-4612-b003-44aa20d013d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:44.473568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2704f3-542b-4612-b003-44aa20d013d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:44.475369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2704f3-542b-4612-b003-44aa20d013d6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:44.516372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 869/1748] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:19:44.520927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89a55f-b871-43ad-ab91-ce18ad403a31 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:44.539426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89a55f-b871-43ad-ab91-ce18ad403a31 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:44.557210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b7294-31f2-42c1-aaa1-55f783bd4b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:44.557983 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7294-31f2-42c1-aaa1-55f783bd4b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:44.558266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7294-31f2-42c1-aaa1-55f783bd4b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:44.558795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7294-31f2-42c1-aaa1-55f783bd4b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:44.559604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b7294-31f2-42c1-aaa1-55f783bd4b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:44.562556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b7294-31f2-42c1-aaa1-55f783bd4b28 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:44.600803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 880/1749] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:44.604983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2704f3-542b-4612-b003-44aa20d013d6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:44.622724 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2704f3-542b-4612-b003-44aa20d013d6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:44.650920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828618a-1902-4aa2-a18f-3ecd051cdfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:44.651788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828618a-1902-4aa2-a18f-3ecd051cdfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:44.652233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828618a-1902-4aa2-a18f-3ecd051cdfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:44.652647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828618a-1902-4aa2-a18f-3ecd051cdfd1 admin admin] PATH_INFO: `/v3/projects/3e6c83b3988f465dbb4ee8a8d43807dc/users/33e2a76f011744af8eb03203258a2fc5/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:44.697318 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828618a-1902-4aa2-a18f-3ecd051cdfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6c83b3988f465dbb4ee8a8d43807dc, user_id=33e2a76f011744af8eb03203258a2fc5, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:44.702902 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828618a-1902-4aa2-a18f-3ecd051cdfd1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:44.817694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 870/1750] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:44 2022] PUT /identity/v3/projects/3e6c83b3988f465dbb4ee8a8d43807dc/users/33e2a76f011744af8eb03203258a2fc5/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:44.819928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9944fb-e906-493b-9719-f69da3749e2c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:44.820376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9944fb-e906-493b-9719-f69da3749e2c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:44.820753 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9944fb-e906-493b-9719-f69da3749e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:44.896906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3c9944fb-e906-493b-9719-f69da3749e2c None None] MFA Rules not processed for user `33e2a76f011744af8eb03203258a2fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:44.900938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3c9944fb-e906-493b-9719-f69da3749e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:45.091104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 881/1751] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:45.096842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828618a-1902-4aa2-a18f-3ecd051cdfd1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:45.198439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9944fb-e906-493b-9719-f69da3749e2c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:45.200640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3c9944fb-e906-493b-9719-f69da3749e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:45.206236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:45.230835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828618a-1902-4aa2-a18f-3ecd051cdfd1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:45.234312 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9944fb-e906-493b-9719-f69da3749e2c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:45.242330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de0d01-ec2b-407a-ad0a-a217239e1a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:45.245081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:45.245854 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de0d01-ec2b-407a-ad0a-a217239e1a49 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:45.247020 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:45.247614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de0d01-ec2b-407a-ad0a-a217239e1a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:45.248101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de0d01-ec2b-407a-ad0a-a217239e1a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:45.249152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de0d01-ec2b-407a-ad0a-a217239e1a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:45.249697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:45.250788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] PATH_INFO: `/v3/projects/72d0d6f5d2434903bfc3070f38960d4c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:45.253021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de0d01-ec2b-407a-ad0a-a217239e1a49 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:45.256649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d0d6f5d2434903bfc3070f38960d4c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:45.260924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:45.435877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 871/1752] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:45 2022] POST /identity/v3/projects => generated 379 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:45.441338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de0d01-ec2b-407a-ad0a-a217239e1a49 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:45.486144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d0d6f5d2434903bfc3070f38960d4c', 'request_id': 'req-c19cb740-d5ff-42fb-8806-cd81d3950b1f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:45.520923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d0d6f5d2434903bfc3070f38960d4c', 'request_id': 'req-c19cb740-d5ff-42fb-8806-cd81d3950b1f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:45.612064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d0d6f5d2434903bfc3070f38960d4c', 'request_id': 'req-c19cb740-d5ff-42fb-8806-cd81d3950b1f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:45.616761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de0d01-ec2b-407a-ad0a-a217239e1a49 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:45.631977 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] The token cache is being invalidate because project 72d0d6f5d2434903bfc3070f38960d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:45.632555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:45.634733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66d42b-76f1-44b4-b6d7-5a9652963a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:45.635094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:45.637648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66d42b-76f1-44b4-b6d7-5a9652963a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:45.638138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66d42b-76f1-44b4-b6d7-5a9652963a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:45.642510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66d42b-76f1-44b4-b6d7-5a9652963a51 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:45.642510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66d42b-76f1-44b4-b6d7-5a9652963a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:45.642704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 882/1753] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:45 2022] DELETE /identity/v3/projects/72d0d6f5d2434903bfc3070f38960d4c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:45.649597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66d42b-76f1-44b4-b6d7-5a9652963a51 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:45.652901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:45.656383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:45.763743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 872/1754] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:45 2022] POST /identity/v3/users => generated 296 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:19:45.766925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66d42b-76f1-44b4-b6d7-5a9652963a51 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:45.774601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-da66d42b-76f1-44b4-b6d7-5a9652963a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:45.817602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66d42b-76f1-44b4-b6d7-5a9652963a51 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:45.835445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515b68-696d-40de-accd-308fdea878fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:45.836572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515b68-696d-40de-accd-308fdea878fa admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:45.837054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515b68-696d-40de-accd-308fdea878fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:45.838404 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515b68-696d-40de-accd-308fdea878fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:45.840462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21515b68-696d-40de-accd-308fdea878fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:45.845668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21515b68-696d-40de-accd-308fdea878fa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:45.863572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cb740-d5ff-42fb-8806-cd81d3950b1f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:45.876250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:45.877122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:45.877681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:45.887164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 873/1755] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:45.889908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515b68-696d-40de-accd-308fdea878fa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:45.890104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] PATH_INFO: `/v3/users/08e5b90a371a4599a0d959dfed4a7342` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:45.894082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e5b90a371a4599a0d959dfed4a7342)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:45.898009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:45.927165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515b68-696d-40de-accd-308fdea878fa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:45.942719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f244dc-52fe-4c5f-8547-9766e05a5385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:45.945465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f244dc-52fe-4c5f-8547-9766e05a5385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:45.947369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f244dc-52fe-4c5f-8547-9766e05a5385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:45.947958 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f244dc-52fe-4c5f-8547-9766e05a5385 admin admin] PATH_INFO: `/v3/projects/ea49d16e77d5460db983e32473daf978/users/9cd35f09f0554e50977bae770cd12217/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:45.994556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f244dc-52fe-4c5f-8547-9766e05a5385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea49d16e77d5460db983e32473daf978, user_id=9cd35f09f0554e50977bae770cd12217, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:46.001891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f244dc-52fe-4c5f-8547-9766e05a5385 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:46.023794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:46.165088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 874/1756] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:45 2022] PUT /identity/v3/projects/ea49d16e77d5460db983e32473daf978/users/9cd35f09f0554e50977bae770cd12217/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:46.169572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f244dc-52fe-4c5f-8547-9766e05a5385 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:46.349853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f244dc-52fe-4c5f-8547-9766e05a5385 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:46.372532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dbe0e-dfaa-402e-9c2d-406b590ede4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:46.373409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dbe0e-dfaa-402e-9c2d-406b590ede4a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:46.374174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dbe0e-dfaa-402e-9c2d-406b590ede4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:46.374641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e5b90a371a4599a0d959dfed4a7342'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:46.375879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dbe0e-dfaa-402e-9c2d-406b590ede4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:46.377042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dbe0e-dfaa-402e-9c2d-406b590ede4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:46.381788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dbe0e-dfaa-402e-9c2d-406b590ede4a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:46.423450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e5b90a371a4599a0d959dfed4a7342'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:46.425133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e5b90a371a4599a0d959dfed4a7342'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:46.426201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 875/1757] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:46.431130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dbe0e-dfaa-402e-9c2d-406b590ede4a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:46.458189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dbe0e-dfaa-402e-9c2d-406b590ede4a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:46.473166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69c686-1d80-4e27-a175-f0aaa0b7c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:46.473984 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69c686-1d80-4e27-a175-f0aaa0b7c685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:46.474270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69c686-1d80-4e27-a175-f0aaa0b7c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:46.474554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69c686-1d80-4e27-a175-f0aaa0b7c685 admin admin] PATH_INFO: `/v3/projects/ea49d16e77d5460db983e32473daf978/users/9cd35f09f0554e50977bae770cd12217/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:46.484634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69c686-1d80-4e27-a175-f0aaa0b7c685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea49d16e77d5460db983e32473daf978, user_id=9cd35f09f0554e50977bae770cd12217, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:46.498279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69c686-1d80-4e27-a175-f0aaa0b7c685 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:46.521856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e5b90a371a4599a0d959dfed4a7342'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:46.547847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 876/1758] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:46 2022] PUT /identity/v3/projects/ea49d16e77d5460db983e32473daf978/users/9cd35f09f0554e50977bae770cd12217/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:46.559711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16448cbd-c85d-431b-9f31-841027604fdc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:46.560066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16448cbd-c85d-431b-9f31-841027604fdc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:46.560456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16448cbd-c85d-431b-9f31-841027604fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:46.563966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e5b90a371a4599a0d959dfed4a7342'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:46.580504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 883/1759] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:45 2022] DELETE /identity/v3/users/08e5b90a371a4599a0d959dfed4a7342 => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:46.664668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-16448cbd-c85d-431b-9f31-841027604fdc None None] MFA Rules not processed for user `9cd35f09f0554e50977bae770cd12217`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:46.665959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16448cbd-c85d-431b-9f31-841027604fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:46.766915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:46.860455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 877/1760] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:19:46.870277 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:46.872872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:47.070317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d35df-29f4-4453-89ae-335b24224f04 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:47.099170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e70cb-2f16-406b-8a9a-670498784ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:47.099780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e70cb-2f16-406b-8a9a-670498784ddd service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:47.100066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e70cb-2f16-406b-8a9a-670498784ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:47.100412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e70cb-2f16-406b-8a9a-670498784ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:47.121800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e70cb-2f16-406b-8a9a-670498784ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:47.125993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e70cb-2f16-406b-8a9a-670498784ddd service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:47.152320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 884/1761] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:48.189336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:48.343057 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16448cbd-c85d-431b-9f31-841027604fdc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:48.344510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16448cbd-c85d-431b-9f31-841027604fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:48.478920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770e6e3-c364-4204-a064-3e44f981df75 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:48.479878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770e6e3-c364-4204-a064-3e44f981df75 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:48.480399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770e6e3-c364-4204-a064-3e44f981df75 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:48.482554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 885/1762] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:19:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 12:19:48.522012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16448cbd-c85d-431b-9f31-841027604fdc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:48.530986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:48.531817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:48.532105 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:48.532461 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] PATH_INFO: `/v3/users/33e2a76f011744af8eb03203258a2fc5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:48.534092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e2a76f011744af8eb03203258a2fc5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:48.543909 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:48.555146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617325-6db4-404d-8098-4fbd8c195a4c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:48.555767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617325-6db4-404d-8098-4fbd8c195a4c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:48.556239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617325-6db4-404d-8098-4fbd8c195a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:48.567419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:48.607943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-84617325-6db4-404d-8098-4fbd8c195a4c None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:48.610988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-84617325-6db4-404d-8098-4fbd8c195a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:48.760831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e2a76f011744af8eb03203258a2fc5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:48.778433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e2a76f011744af8eb03203258a2fc5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:48.825724 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 886/1763] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:19:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:19:48.826928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617325-6db4-404d-8098-4fbd8c195a4c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:48.830256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-84617325-6db4-404d-8098-4fbd8c195a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:48.849518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617325-6db4-404d-8098-4fbd8c195a4c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:48.854795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:48.858754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:48.859311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:48.859948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] PATH_INFO: `/v3/projects/09e4e05678744c288b66eabd1b0c43fa` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:48.869031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e4e05678744c288b66eabd1b0c43fa)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:48.871076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:48.932265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e2a76f011744af8eb03203258a2fc5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:48.933668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e2a76f011744af8eb03203258a2fc5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:48.936237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79ed9ae9-3135-4d82-9a61-0499df799262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e2a76f011744af8eb03203258a2fc5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:48.966833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 878/1764] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:48 2022] DELETE /identity/v3/users/33e2a76f011744af8eb03203258a2fc5 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:48.982005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff1d2b-0ccf-4b77-b586-5326b53f86a7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:48.988013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff1d2b-0ccf-4b77-b586-5326b53f86a7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:48.989152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff1d2b-0ccf-4b77-b586-5326b53f86a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:49.015456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0bff1d2b-0ccf-4b77-b586-5326b53f86a7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:49.016927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0bff1d2b-0ccf-4b77-b586-5326b53f86a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:49.026760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:49.061009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e4e05678744c288b66eabd1b0c43fa', 'request_id': 'req-0de55a7e-15fe-433d-8661-be9ab0abff50'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:49.082284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e4e05678744c288b66eabd1b0c43fa', 'request_id': 'req-0de55a7e-15fe-433d-8661-be9ab0abff50'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:49.132469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 879/1765] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:49.190138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e4e05678744c288b66eabd1b0c43fa', 'request_id': 'req-0de55a7e-15fe-433d-8661-be9ab0abff50'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:49.221005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] The token cache is being invalidate because project 09e4e05678744c288b66eabd1b0c43fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:49.221399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:49.227608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0de55a7e-15fe-433d-8661-be9ab0abff50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:49.237106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 887/1766] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:48 2022] DELETE /identity/v3/projects/09e4e05678744c288b66eabd1b0c43fa => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:49.240705 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6522e-81bf-406d-b22d-8d9606766245 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:49.241650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6522e-81bf-406d-b22d-8d9606766245 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:49.242202 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6522e-81bf-406d-b22d-8d9606766245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:49.310921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8dd6522e-81bf-406d-b22d-8d9606766245 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:49.322794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8dd6522e-81bf-406d-b22d-8d9606766245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:49.353918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 880/1767] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:49.362360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca49e-077c-4b61-a858-d01496af594c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:49.362655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca49e-077c-4b61-a858-d01496af594c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:49.362936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca49e-077c-4b61-a858-d01496af594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:49.368532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6522e-81bf-406d-b22d-8d9606766245 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:49.370304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8dd6522e-81bf-406d-b22d-8d9606766245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:49.473613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9d7ca49e-077c-4b61-a858-d01496af594c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:49.474926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9d7ca49e-077c-4b61-a858-d01496af594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:49.542515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 888/1768] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:49.547453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca49e-077c-4b61-a858-d01496af594c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:49.585333 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca49e-077c-4b61-a858-d01496af594c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:49.596427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb90ecf-117a-4687-ab05-9dd11ba732cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:49.597057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb90ecf-117a-4687-ab05-9dd11ba732cc admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:49.597337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb90ecf-117a-4687-ab05-9dd11ba732cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:49.597700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb90ecf-117a-4687-ab05-9dd11ba732cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:49.603393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb90ecf-117a-4687-ab05-9dd11ba732cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:49.603731 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb90ecf-117a-4687-ab05-9dd11ba732cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:49.606166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6522e-81bf-406d-b22d-8d9606766245 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:49.607329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb90ecf-117a-4687-ab05-9dd11ba732cc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:49.615932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f23e6-858d-4731-b676-9668aaa6e005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:49.618368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f23e6-858d-4731-b676-9668aaa6e005 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:49.618811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f23e6-858d-4731-b676-9668aaa6e005 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:49.619132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f23e6-858d-4731-b676-9668aaa6e005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:49.625917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-164f23e6-858d-4731-b676-9668aaa6e005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:49.640689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 889/1769] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:49.659865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb90ecf-117a-4687-ab05-9dd11ba732cc admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:49.703140 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:49.707796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f23e6-858d-4731-b676-9668aaa6e005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:49.709522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f23e6-858d-4731-b676-9668aaa6e005 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:49.733609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb90ecf-117a-4687-ab05-9dd11ba732cc admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:49.739056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243170b5-a087-4f70-8e7a-871cc1cf2bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:49.739686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243170b5-a087-4f70-8e7a-871cc1cf2bed admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:49.739972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243170b5-a087-4f70-8e7a-871cc1cf2bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:49.740413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243170b5-a087-4f70-8e7a-871cc1cf2bed admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:49.741073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243170b5-a087-4f70-8e7a-871cc1cf2bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:49.743585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243170b5-a087-4f70-8e7a-871cc1cf2bed admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:49.745126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 881/1770] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:49.777176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249723-abfc-4634-8bc9-442e16dc9324 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:49.777470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249723-abfc-4634-8bc9-442e16dc9324 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:49.777767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249723-abfc-4634-8bc9-442e16dc9324 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:49.781454 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 882/1771] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:19:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 12:19:49.810494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28854c0f-4c0b-41bf-bed3-14a14fd51181 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:49.810787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28854c0f-4c0b-41bf-bed3-14a14fd51181 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:49.811068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28854c0f-4c0b-41bf-bed3-14a14fd51181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:49.872945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-28854c0f-4c0b-41bf-bed3-14a14fd51181 None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:49.873456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-28854c0f-4c0b-41bf-bed3-14a14fd51181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:49.884279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 890/1772] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:49 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:49.886291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243170b5-a087-4f70-8e7a-871cc1cf2bed admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:50.057644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:50.187711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243170b5-a087-4f70-8e7a-871cc1cf2bed admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:50.231952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640fccc-d7c5-4af2-b61c-f3c21ee991ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:50.232931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640fccc-d7c5-4af2-b61c-f3c21ee991ff admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:50.233486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640fccc-d7c5-4af2-b61c-f3c21ee991ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:50.233657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640fccc-d7c5-4af2-b61c-f3c21ee991ff admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:50.234320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640fccc-d7c5-4af2-b61c-f3c21ee991ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:50.236338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 883/1773] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:19:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:50.240952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640fccc-d7c5-4af2-b61c-f3c21ee991ff admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:50.377452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 891/1774] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:49 2022] POST /identity/v3/users => generated 290 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:50.378606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28854c0f-4c0b-41bf-bed3-14a14fd51181 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:50.399257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28854c0f-4c0b-41bf-bed3-14a14fd51181 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:50.418236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676b5a0-2d41-4770-9fed-d18ac17cf3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:50.418914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676b5a0-2d41-4770-9fed-d18ac17cf3bf admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:50.423862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676b5a0-2d41-4770-9fed-d18ac17cf3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:50.424129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676b5a0-2d41-4770-9fed-d18ac17cf3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:50.425180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676b5a0-2d41-4770-9fed-d18ac17cf3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:50.426853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676b5a0-2d41-4770-9fed-d18ac17cf3bf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:50.450956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 884/1775] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:50.452646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640fccc-d7c5-4af2-b61c-f3c21ee991ff admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:50.474673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640fccc-d7c5-4af2-b61c-f3c21ee991ff admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:50.496837 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604b529-0338-4cbb-a216-15b81c682b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:50.497776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604b529-0338-4cbb-a216-15b81c682b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:50.499418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604b529-0338-4cbb-a216-15b81c682b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:50.502281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604b529-0338-4cbb-a216-15b81c682b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:50.505006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604b529-0338-4cbb-a216-15b81c682b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:50.506906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604b529-0338-4cbb-a216-15b81c682b00 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:50.554710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 892/1776] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:50.555840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676b5a0-2d41-4770-9fed-d18ac17cf3bf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:50.570858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676b5a0-2d41-4770-9fed-d18ac17cf3bf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:50.584790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89e73c-49a2-4961-a283-b62b119465e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:50.589678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89e73c-49a2-4961-a283-b62b119465e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:50.590130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89e73c-49a2-4961-a283-b62b119465e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:50.590759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89e73c-49a2-4961-a283-b62b119465e0 admin admin] PATH_INFO: `/v3/projects/5fa5edd103a44a06996542a08b608647/users/94ae3391b37840dfb2987695d8381941/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:50.636451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89e73c-49a2-4961-a283-b62b119465e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa5edd103a44a06996542a08b608647, user_id=94ae3391b37840dfb2987695d8381941, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:50.640423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89e73c-49a2-4961-a283-b62b119465e0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:50.764095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 885/1777] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:50 2022] PUT /identity/v3/projects/5fa5edd103a44a06996542a08b608647/users/94ae3391b37840dfb2987695d8381941/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:19:50.776000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f064-8ea1-4ab0-801d-f4964a9e76d7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:50.776332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f064-8ea1-4ab0-801d-f4964a9e76d7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:50.776598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f064-8ea1-4ab0-801d-f4964a9e76d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:50.887972 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89e73c-49a2-4961-a283-b62b119465e0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:50.890882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e89e73c-49a2-4961-a283-b62b119465e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:50.894612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1672f064-8ea1-4ab0-801d-f4964a9e76d7 None None] MFA Rules not processed for user `94ae3391b37840dfb2987695d8381941`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:50.896364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1672f064-8ea1-4ab0-801d-f4964a9e76d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:50.997861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 893/1778] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:50.999882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672f064-8ea1-4ab0-801d-f4964a9e76d7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:51.026793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89e73c-49a2-4961-a283-b62b119465e0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:51.042781 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cc7b8-b5f7-4576-9294-d74b16f558e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:51.044657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cc7b8-b5f7-4576-9294-d74b16f558e7 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:51.046624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cc7b8-b5f7-4576-9294-d74b16f558e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:51.046974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cc7b8-b5f7-4576-9294-d74b16f558e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:51.049561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a2cc7b8-b5f7-4576-9294-d74b16f558e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:51.077565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cc7b8-b5f7-4576-9294-d74b16f558e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:51.079440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cc7b8-b5f7-4576-9294-d74b16f558e7 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:51.087825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:51.096668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 886/1779] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:19:51.104421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672f064-8ea1-4ab0-801d-f4964a9e76d7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:51.110495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa37e-75e8-4441-8394-ddf772e1bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:51.111497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa37e-75e8-4441-8394-ddf772e1bd39 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:51.111991 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa37e-75e8-4441-8394-ddf772e1bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:51.112549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa37e-75e8-4441-8394-ddf772e1bd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:51.113384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaa37e-75e8-4441-8394-ddf772e1bd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:51.118012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaa37e-75e8-4441-8394-ddf772e1bd39 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:51.327503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 894/1780] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:50 2022] POST /identity/v3/projects => generated 379 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:51.331568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cc7b8-b5f7-4576-9294-d74b16f558e7 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:51.348290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cc7b8-b5f7-4576-9294-d74b16f558e7 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:51.504008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555dc5-fd5a-43d0-b116-0038f6cbcce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:51.504739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555dc5-fd5a-43d0-b116-0038f6cbcce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:51.505347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555dc5-fd5a-43d0-b116-0038f6cbcce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:51.505792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555dc5-fd5a-43d0-b116-0038f6cbcce0 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:51.506774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555dc5-fd5a-43d0-b116-0038f6cbcce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:51.512143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555dc5-fd5a-43d0-b116-0038f6cbcce0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:51.519510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa37e-75e8-4441-8394-ddf772e1bd39 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:51.603961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:51.619165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 887/1781] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:51 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:51.623776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555dc5-fd5a-43d0-b116-0038f6cbcce0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:51.664740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555dc5-fd5a-43d0-b116-0038f6cbcce0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:51.678588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa37e-75e8-4441-8394-ddf772e1bd39 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:51.687132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce765392-2a8f-43f4-b591-7e741ac29dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:51.693055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce765392-2a8f-43f4-b591-7e741ac29dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:51.694283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce765392-2a8f-43f4-b591-7e741ac29dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:51.695683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce765392-2a8f-43f4-b591-7e741ac29dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:51.698701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce765392-2a8f-43f4-b591-7e741ac29dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:51.701306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a087c1e-2567-40da-be8b-c5a52a13d210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:51.701306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a087c1e-2567-40da-be8b-c5a52a13d210 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:51.701306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a087c1e-2567-40da-be8b-c5a52a13d210 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:51.701306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a087c1e-2567-40da-be8b-c5a52a13d210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:51.714536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a087c1e-2567-40da-be8b-c5a52a13d210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:51.715296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce765392-2a8f-43f4-b591-7e741ac29dfd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:51.716664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a087c1e-2567-40da-be8b-c5a52a13d210 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:51.762254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 895/1782] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:51.773504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 888/1783] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:51.774865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a087c1e-2567-40da-be8b-c5a52a13d210 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:51.800523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a087c1e-2567-40da-be8b-c5a52a13d210 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:51.825546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb120d9-e1f0-4d28-a430-43bed4fb257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:51.827900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb120d9-e1f0-4d28-a430-43bed4fb257a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:51.828223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb120d9-e1f0-4d28-a430-43bed4fb257a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:51.828508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb120d9-e1f0-4d28-a430-43bed4fb257a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:51.835929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb120d9-e1f0-4d28-a430-43bed4fb257a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:51.838672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb120d9-e1f0-4d28-a430-43bed4fb257a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:51.902859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 896/1784] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:19:51.904018 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce765392-2a8f-43f4-b591-7e741ac29dfd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:51.937667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce765392-2a8f-43f4-b591-7e741ac29dfd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:51.973874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caa218-8a2d-403f-8faa-39a41bdfa34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:51.978051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caa218-8a2d-403f-8faa-39a41bdfa34e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:51.979631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caa218-8a2d-403f-8faa-39a41bdfa34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:51.981762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caa218-8a2d-403f-8faa-39a41bdfa34e admin admin] PATH_INFO: `/v3/projects/049199fed7d443f98693f00ad292ec0d/users/f2b27403c9864181b41658e954f41be1/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:52.026772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caa218-8a2d-403f-8faa-39a41bdfa34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=049199fed7d443f98693f00ad292ec0d, user_id=f2b27403c9864181b41658e954f41be1, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:52.030929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caa218-8a2d-403f-8faa-39a41bdfa34e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:52.124156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 889/1785] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:51 2022] PUT /identity/v3/projects/049199fed7d443f98693f00ad292ec0d/users/f2b27403c9864181b41658e954f41be1/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:19:52.135522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e35d5-1f7d-4b78-88c7-0faaf8fa3c29 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:52.136031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e35d5-1f7d-4b78-88c7-0faaf8fa3c29 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:52.136288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e35d5-1f7d-4b78-88c7-0faaf8fa3c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:52.222680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-941e35d5-1f7d-4b78-88c7-0faaf8fa3c29 None None] MFA Rules not processed for user `f2b27403c9864181b41658e954f41be1`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:52.223856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-941e35d5-1f7d-4b78-88c7-0faaf8fa3c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:52.362636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 897/1786] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:52.368691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caa218-8a2d-403f-8faa-39a41bdfa34e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:52.442820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e35d5-1f7d-4b78-88c7-0faaf8fa3c29 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:52.444646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-941e35d5-1f7d-4b78-88c7-0faaf8fa3c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:52.589760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caa218-8a2d-403f-8faa-39a41bdfa34e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:52.608084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32ef3-db68-4115-a2cf-309e3d8b88d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:52.609286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32ef3-db68-4115-a2cf-309e3d8b88d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:52.609566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32ef3-db68-4115-a2cf-309e3d8b88d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:52.609922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32ef3-db68-4115-a2cf-309e3d8b88d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:52.610649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32ef3-db68-4115-a2cf-309e3d8b88d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:52.613976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e35d5-1f7d-4b78-88c7-0faaf8fa3c29 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:52.615040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32ef3-db68-4115-a2cf-309e3d8b88d8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:52.624851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:52.625509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:52.626030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:52.626195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] PATH_INFO: `/v3/projects/3e6c83b3988f465dbb4ee8a8d43807dc` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:52.627707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6c83b3988f465dbb4ee8a8d43807dc)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:52.632609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:52.769434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 890/1787] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:52 2022] POST /identity/v3/projects => generated 379 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:52.771777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32ef3-db68-4115-a2cf-309e3d8b88d8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:52.794448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:52.814858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6c83b3988f465dbb4ee8a8d43807dc', 'request_id': 'req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:52.834838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6c83b3988f465dbb4ee8a8d43807dc', 'request_id': 'req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:52.890591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:52.949392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6c83b3988f465dbb4ee8a8d43807dc', 'request_id': 'req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:52.972556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] The token cache is being invalidate because project 3e6c83b3988f465dbb4ee8a8d43807dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:52.974306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:52.975701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:52.980284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 898/1788] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:52 2022] DELETE /identity/v3/projects/3e6c83b3988f465dbb4ee8a8d43807dc => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:52.985668 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:52.991611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:52.994299 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32ef3-db68-4115-a2cf-309e3d8b88d8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:53.125063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f2073-d197-41cd-ab57-a1c5f1e4618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:53.128620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f2073-d197-41cd-ab57-a1c5f1e4618e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:53.131586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f2073-d197-41cd-ab57-a1c5f1e4618e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:53.132921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f2073-d197-41cd-ab57-a1c5f1e4618e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:53.135116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f2073-d197-41cd-ab57-a1c5f1e4618e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:53.149617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f2073-d197-41cd-ab57-a1c5f1e4618e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:53.175041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdc4fd-c878-45f7-8f2a-c4be52f94021 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:53.185304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:53.186031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:53.186864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:53.187177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] PATH_INFO: `/v3/users/9cd35f09f0554e50977bae770cd12217` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:53.188772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd35f09f0554e50977bae770cd12217)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:53.193905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:53.294528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 891/1789] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:52 2022] POST /identity/v3/users => generated 296 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:53.298165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f2073-d197-41cd-ab57-a1c5f1e4618e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:53.302070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-630f2073-d197-41cd-ab57-a1c5f1e4618e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:53.330451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f2073-d197-41cd-ab57-a1c5f1e4618e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:53.337753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec85cf5-6c02-4737-873d-bf0286ca73f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:53.338734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85cf5-6c02-4737-873d-bf0286ca73f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:53.339168 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85cf5-6c02-4737-873d-bf0286ca73f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:53.339583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85cf5-6c02-4737-873d-bf0286ca73f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:53.340503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec85cf5-6c02-4737-873d-bf0286ca73f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:53.343048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec85cf5-6c02-4737-873d-bf0286ca73f3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:53.366125 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 892/1790] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:53.367415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec85cf5-6c02-4737-873d-bf0286ca73f3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:53.382766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec85cf5-6c02-4737-873d-bf0286ca73f3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:53.388742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb61734-d970-4991-88f2-77db1f0887ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:53.390149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb61734-d970-4991-88f2-77db1f0887ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:53.390610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb61734-d970-4991-88f2-77db1f0887ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:53.393290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb61734-d970-4991-88f2-77db1f0887ab admin admin] PATH_INFO: `/v3/projects/5a121c0e4f134f25816b470ccc2e9049/users/9d559166f3e74adcbfc48674860ad81d/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:53.414083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb61734-d970-4991-88f2-77db1f0887ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a121c0e4f134f25816b470ccc2e9049, user_id=9d559166f3e74adcbfc48674860ad81d, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:53.417974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb61734-d970-4991-88f2-77db1f0887ab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:53.456659 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd35f09f0554e50977bae770cd12217'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:53.473718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd35f09f0554e50977bae770cd12217'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:53.474696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd35f09f0554e50977bae770cd12217'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:53.528556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 893/1791] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:53 2022] PUT /identity/v3/projects/5a121c0e4f134f25816b470ccc2e9049/users/9d559166f3e74adcbfc48674860ad81d/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:53.533872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb61734-d970-4991-88f2-77db1f0887ab admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:53.550986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd35f09f0554e50977bae770cd12217'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:53.593522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd35f09f0554e50977bae770cd12217'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:53.633518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 899/1792] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:52 2022] DELETE /identity/v3/users/9cd35f09f0554e50977bae770cd12217 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:53.734633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb61734-d970-4991-88f2-77db1f0887ab admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:53.834257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:53.851219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4455994-f902-417c-9c16-b13245b01ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:53.851950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4455994-f902-417c-9c16-b13245b01ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:53.852387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4455994-f902-417c-9c16-b13245b01ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:53.852751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4455994-f902-417c-9c16-b13245b01ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:53.853486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4455994-f902-417c-9c16-b13245b01ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:53.855632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4455994-f902-417c-9c16-b13245b01ea4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:53.883059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 894/1793] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:53.886978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:53.888849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:53.909402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3f4b0-49e1-42b6-8f3d-92f039245a16 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:53.916008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df0314-00f0-4936-a3b4-659125700688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:53.917050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df0314-00f0-4936-a3b4-659125700688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:53.917460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df0314-00f0-4936-a3b4-659125700688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:53.917749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df0314-00f0-4936-a3b4-659125700688 admin admin] PATH_INFO: `/v3/projects/5a121c0e4f134f25816b470ccc2e9049/users/9d559166f3e74adcbfc48674860ad81d/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:53.919747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df0314-00f0-4936-a3b4-659125700688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a121c0e4f134f25816b470ccc2e9049, user_id=9d559166f3e74adcbfc48674860ad81d, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:53.923452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df0314-00f0-4936-a3b4-659125700688 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:53.946850 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 900/1794] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:53 2022] PUT /identity/v3/projects/5a121c0e4f134f25816b470ccc2e9049/users/9d559166f3e74adcbfc48674860ad81d/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:19:53.946944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d916a08-d7e6-4988-9c3b-f6a2870a7255 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:53.946944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d916a08-d7e6-4988-9c3b-f6a2870a7255 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:53.946944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d916a08-d7e6-4988-9c3b-f6a2870a7255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:53.995940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7d916a08-d7e6-4988-9c3b-f6a2870a7255 None None] MFA Rules not processed for user `9d559166f3e74adcbfc48674860ad81d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:53.997107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7d916a08-d7e6-4988-9c3b-f6a2870a7255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:54.078953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 895/1795] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:54.091530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df0314-00f0-4936-a3b4-659125700688 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:54.093849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-11df0314-00f0-4936-a3b4-659125700688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:54.138589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:54.165900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df0314-00f0-4936-a3b4-659125700688 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:54.169692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b1c6d-0d56-4652-bd03-eab31e38b52e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:54.170330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b1c6d-0d56-4652-bd03-eab31e38b52e service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:54.171246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b1c6d-0d56-4652-bd03-eab31e38b52e service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:54.171568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b1c6d-0d56-4652-bd03-eab31e38b52e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:54.183082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b1c6d-0d56-4652-bd03-eab31e38b52e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:54.184570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b1c6d-0d56-4652-bd03-eab31e38b52e service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:54.198845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 901/1796] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:54.336593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d916a08-d7e6-4988-9c3b-f6a2870a7255 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:54.339045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7d916a08-d7e6-4988-9c3b-f6a2870a7255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:54.352801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d916a08-d7e6-4988-9c3b-f6a2870a7255 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:54.359535 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bf8e3-3088-4f65-af48-ecc928feba34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:54.360397 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bf8e3-3088-4f65-af48-ecc928feba34 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:54.360806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bf8e3-3088-4f65-af48-ecc928feba34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:54.361111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bf8e3-3088-4f65-af48-ecc928feba34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:54.363578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ae3bf8e3-3088-4f65-af48-ecc928feba34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:54.466884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bf8e3-3088-4f65-af48-ecc928feba34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:54.468607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bf8e3-3088-4f65-af48-ecc928feba34 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:54.482956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 896/1797] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:19:54.631029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b1c6d-0d56-4652-bd03-eab31e38b52e service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:54.632481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e25b1c6d-0d56-4652-bd03-eab31e38b52e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:54.760741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b1c6d-0d56-4652-bd03-eab31e38b52e service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:54.770579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:54.771436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:54.771875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:54.772350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] PATH_INFO: `/v3/projects/ea49d16e77d5460db983e32473daf978` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:54.782660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea49d16e77d5460db983e32473daf978)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:54.782660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:54.934726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea49d16e77d5460db983e32473daf978', 'request_id': 'req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:54.942251 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea49d16e77d5460db983e32473daf978', 'request_id': 'req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:55.018447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea49d16e77d5460db983e32473daf978', 'request_id': 'req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:55.037536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] The token cache is being invalidate because project ea49d16e77d5460db983e32473daf978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:55.037836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:55.039650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b9fdbff-73a9-4bb0-bed0-1dda192e0807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:55.041540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 902/1798] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:54 2022] DELETE /identity/v3/projects/ea49d16e77d5460db983e32473daf978 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:55.046360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d02f-241a-4ccf-b738-0621baf1fe90 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:55.046870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d02f-241a-4ccf-b738-0621baf1fe90 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:55.046960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d02f-241a-4ccf-b738-0621baf1fe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:55.086534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3d59d02f-241a-4ccf-b738-0621baf1fe90 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:55.087860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3d59d02f-241a-4ccf-b738-0621baf1fe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:55.233527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 897/1799] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:55.233708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b645f5c-13ec-417f-9121-41bbd641f752 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:55.233708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b645f5c-13ec-417f-9121-41bbd641f752 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:55.233708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b645f5c-13ec-417f-9121-41bbd641f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:55.264175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4b645f5c-13ec-417f-9121-41bbd641f752 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:55.265995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4b645f5c-13ec-417f-9121-41bbd641f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:55.279044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 903/1800] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:55.286483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59d02f-241a-4ccf-b738-0621baf1fe90 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:55.296661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59d02f-241a-4ccf-b738-0621baf1fe90 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:55.301382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c4a4f-8d5c-43ab-beb1-79560055ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:55.302061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c4a4f-8d5c-43ab-beb1-79560055ade5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:55.302349 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c4a4f-8d5c-43ab-beb1-79560055ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:55.302627 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c4a4f-8d5c-43ab-beb1-79560055ade5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:55.303315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c4a4f-8d5c-43ab-beb1-79560055ade5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:55.303624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c4a4f-8d5c-43ab-beb1-79560055ade5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:55.305302 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c4a4f-8d5c-43ab-beb1-79560055ade5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:55.308143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:55.328499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 898/1801] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:55.332871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b645f5c-13ec-417f-9121-41bbd641f752 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:55.343291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b645f5c-13ec-417f-9121-41bbd641f752 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:55.348333 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf6c41-95b4-4e2b-ab05-6ea4a974d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:55.348961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf6c41-95b4-4e2b-ab05-6ea4a974d288 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:55.349485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf6c41-95b4-4e2b-ab05-6ea4a974d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:55.349764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf6c41-95b4-4e2b-ab05-6ea4a974d288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:55.350465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf6c41-95b4-4e2b-ab05-6ea4a974d288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:55.352396 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf6c41-95b4-4e2b-ab05-6ea4a974d288 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:55.438586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 904/1802] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:55 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:55.442273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c4a4f-8d5c-43ab-beb1-79560055ade5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:55.453977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c4a4f-8d5c-43ab-beb1-79560055ade5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:55.526050 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce5162-770b-485c-af1a-d8f2388c0b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:55.526674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce5162-770b-485c-af1a-d8f2388c0b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:55.526958 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce5162-770b-485c-af1a-d8f2388c0b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:55.527234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce5162-770b-485c-af1a-d8f2388c0b02 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:55.527956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce5162-770b-485c-af1a-d8f2388c0b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:55.540931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce5162-770b-485c-af1a-d8f2388c0b02 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:55.659409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 899/1803] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:55 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:19:55.664520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf6c41-95b4-4e2b-ab05-6ea4a974d288 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:55.676291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf6c41-95b4-4e2b-ab05-6ea4a974d288 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:55.682592 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c14f1-1865-406c-bf5b-c1fb078bd6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:55.683240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c14f1-1865-406c-bf5b-c1fb078bd6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:55.683523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c14f1-1865-406c-bf5b-c1fb078bd6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:55.683791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c14f1-1865-406c-bf5b-c1fb078bd6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:55.684534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c14f1-1865-406c-bf5b-c1fb078bd6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:55.686093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c14f1-1865-406c-bf5b-c1fb078bd6ba admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:55.698904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 905/1804] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:55.703307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce5162-770b-485c-af1a-d8f2388c0b02 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:55.713870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce5162-770b-485c-af1a-d8f2388c0b02 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:55.718918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05375e8c-b128-4395-bab0-c252fde4d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:55.719527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05375e8c-b128-4395-bab0-c252fde4d984 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:55.719810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05375e8c-b128-4395-bab0-c252fde4d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:55.720087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05375e8c-b128-4395-bab0-c252fde4d984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:55.720802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05375e8c-b128-4395-bab0-c252fde4d984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:55.722539 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05375e8c-b128-4395-bab0-c252fde4d984 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:55.734272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 900/1805] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:19:55.738672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c14f1-1865-406c-bf5b-c1fb078bd6ba admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:55.749877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c14f1-1865-406c-bf5b-c1fb078bd6ba admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:55.754572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb1422-0acb-4b77-86d2-5d683fc91dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:55.755228 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb1422-0acb-4b77-86d2-5d683fc91dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:55.755506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb1422-0acb-4b77-86d2-5d683fc91dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:55.755778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb1422-0acb-4b77-86d2-5d683fc91dcd admin admin] PATH_INFO: `/v3/projects/81ee10ac4154494b99298360c5552d7d/users/7f0de71601484c3c90aab0333715dd79/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:55.770487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb1422-0acb-4b77-86d2-5d683fc91dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ee10ac4154494b99298360c5552d7d, user_id=7f0de71601484c3c90aab0333715dd79, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:55.773168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb1422-0acb-4b77-86d2-5d683fc91dcd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:55.864164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:55.869189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 906/1806] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:55 2022] PUT /identity/v3/projects/81ee10ac4154494b99298360c5552d7d/users/7f0de71601484c3c90aab0333715dd79/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:55.880581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3f0b-41c9-4a87-8e34-ffa4b160d09e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:55.880858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3f0b-41c9-4a87-8e34-ffa4b160d09e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:55.881135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3f0b-41c9-4a87-8e34-ffa4b160d09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:55.914836 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-547a3f0b-41c9-4a87-8e34-ffa4b160d09e None None] MFA Rules not processed for user `7f0de71601484c3c90aab0333715dd79`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:55.916270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-547a3f0b-41c9-4a87-8e34-ffa4b160d09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:56.001462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 901/1807] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:56.015953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb1422-0acb-4b77-86d2-5d683fc91dcd admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:56.017717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e2cb1422-0acb-4b77-86d2-5d683fc91dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:56.078628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb1422-0acb-4b77-86d2-5d683fc91dcd admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:56.082798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14fed1-f91a-4e4b-ba28-e11dc1266240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:56.083409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14fed1-f91a-4e4b-ba28-e11dc1266240 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:56.083685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14fed1-f91a-4e4b-ba28-e11dc1266240 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:56.083953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14fed1-f91a-4e4b-ba28-e11dc1266240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:56.100203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14fed1-f91a-4e4b-ba28-e11dc1266240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:56.101664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14fed1-f91a-4e4b-ba28-e11dc1266240 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:56.112403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 907/1808] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:19:56.140825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a3f0b-41c9-4a87-8e34-ffa4b160d09e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:56.211347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a3f0b-41c9-4a87-8e34-ffa4b160d09e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:56.216366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:56.217090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:56.217475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:56.217844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] PATH_INFO: `/v3/users/7f0de71601484c3c90aab0333715dd79` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:56.219109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0de71601484c3c90aab0333715dd79)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:56.221135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:56.232203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:56.473545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0de71601484c3c90aab0333715dd79'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:56.484015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0de71601484c3c90aab0333715dd79'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:56.623512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0de71601484c3c90aab0333715dd79'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:56.628002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0de71601484c3c90aab0333715dd79'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:56.629032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0de71601484c3c90aab0333715dd79'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:56.649214 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 902/1809] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:56 2022] DELETE /identity/v3/users/7f0de71601484c3c90aab0333715dd79 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:56.653957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde37e9-23b2-43f7-8027-4709d0ef7e3c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:56.654489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde37e9-23b2-43f7-8027-4709d0ef7e3c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:56.654849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde37e9-23b2-43f7-8027-4709d0ef7e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:56.675047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5cde37e9-23b2-43f7-8027-4709d0ef7e3c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:56.676457 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5cde37e9-23b2-43f7-8027-4709d0ef7e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:56.740689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 908/1810] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:19:56.751699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:56.753352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:56.811595 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b2dd7-b541-4b94-a848-cd8d51ec0df6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:56.815745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6f7c5-fee9-48a8-9fe3-c863cf681926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:56.816383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6f7c5-fee9-48a8-9fe3-c863cf681926 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:56.816658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6f7c5-fee9-48a8-9fe3-c863cf681926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:56.816926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6f7c5-fee9-48a8-9fe3-c863cf681926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:56.826729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6f7c5-fee9-48a8-9fe3-c863cf681926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:56.828459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6f7c5-fee9-48a8-9fe3-c863cf681926 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:56.838930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 903/1811] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:19:57.340125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde37e9-23b2-43f7-8027-4709d0ef7e3c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:57.341765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5cde37e9-23b2-43f7-8027-4709d0ef7e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:57.354800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde37e9-23b2-43f7-8027-4709d0ef7e3c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:57.361072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:57.361898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:57.362284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:57.362658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] PATH_INFO: `/v3/projects/81ee10ac4154494b99298360c5552d7d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:57.364046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ee10ac4154494b99298360c5552d7d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:57.366027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:57.470526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ee10ac4154494b99298360c5552d7d', 'request_id': 'req-3c508a14-cddb-4adc-abc3-78c09923fa5f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:57.477308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ee10ac4154494b99298360c5552d7d', 'request_id': 'req-3c508a14-cddb-4adc-abc3-78c09923fa5f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:57.537524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ee10ac4154494b99298360c5552d7d', 'request_id': 'req-3c508a14-cddb-4adc-abc3-78c09923fa5f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:57.549089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] The token cache is being invalidate because project 81ee10ac4154494b99298360c5552d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:19:57.549388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:57.550043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c508a14-cddb-4adc-abc3-78c09923fa5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:19:57.551568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 909/1812] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:19:57 2022] DELETE /identity/v3/projects/81ee10ac4154494b99298360c5552d7d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:57.556572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001791d7-5d86-4c45-b20b-0a56ba787348 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:57.557062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001791d7-5d86-4c45-b20b-0a56ba787348 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:57.557180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001791d7-5d86-4c45-b20b-0a56ba787348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:57.587544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-001791d7-5d86-4c45-b20b-0a56ba787348 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:57.587544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-001791d7-5d86-4c45-b20b-0a56ba787348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:57.671713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 904/1813] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:57.679677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bac0e-c612-4999-b3c9-7858c335fc0a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:57.681556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bac0e-c612-4999-b3c9-7858c335fc0a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:57.681556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bac0e-c612-4999-b3c9-7858c335fc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:57.706010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-dc4bac0e-c612-4999-b3c9-7858c335fc0a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:57.707366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-dc4bac0e-c612-4999-b3c9-7858c335fc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:57.727506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 910/1814] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:57.731960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001791d7-5d86-4c45-b20b-0a56ba787348 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:57.743578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001791d7-5d86-4c45-b20b-0a56ba787348 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:57.749481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a2d6-3b7f-4b64-9dae-ac3566169f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:57.750541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a2d6-3b7f-4b64-9dae-ac3566169f5f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:57.750541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a2d6-3b7f-4b64-9dae-ac3566169f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:57.750875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a2d6-3b7f-4b64-9dae-ac3566169f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:57.751558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6a2d6-3b7f-4b64-9dae-ac3566169f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:19:57.751875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6a2d6-3b7f-4b64-9dae-ac3566169f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:57.757924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6a2d6-3b7f-4b64-9dae-ac3566169f5f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:57.769987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 905/1815] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:19:57.774532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bac0e-c612-4999-b3c9-7858c335fc0a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:57.784996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bac0e-c612-4999-b3c9-7858c335fc0a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:57.789934 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e209a-d7bb-4178-ada7-55bfa898c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:57.790572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e209a-d7bb-4178-ada7-55bfa898c0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:57.790860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e209a-d7bb-4178-ada7-55bfa898c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:57.791138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e209a-d7bb-4178-ada7-55bfa898c0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:57.791785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e209a-d7bb-4178-ada7-55bfa898c0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:57.793773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e209a-d7bb-4178-ada7-55bfa898c0e0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:57.922568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:57.933662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 911/1816] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:57 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:57.934801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a2d6-3b7f-4b64-9dae-ac3566169f5f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:57.960837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a2d6-3b7f-4b64-9dae-ac3566169f5f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:57.971443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:58.024933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04318bf-e263-4634-831c-023b86c7c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:58.025538 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04318bf-e263-4634-831c-023b86c7c053 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:58.025816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04318bf-e263-4634-831c-023b86c7c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:58.026090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04318bf-e263-4634-831c-023b86c7c053 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:58.026757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04318bf-e263-4634-831c-023b86c7c053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:58.028680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04318bf-e263-4634-831c-023b86c7c053 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:58.137338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 906/1817] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:57 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:19:58.142743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e209a-d7bb-4178-ada7-55bfa898c0e0 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:58.152849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e209a-d7bb-4178-ada7-55bfa898c0e0 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:58.157873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb20fd7-63e7-47dd-8514-4f73ca0b25a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:58.158478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb20fd7-63e7-47dd-8514-4f73ca0b25a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:58.158756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb20fd7-63e7-47dd-8514-4f73ca0b25a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:58.159030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb20fd7-63e7-47dd-8514-4f73ca0b25a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:58.159675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb20fd7-63e7-47dd-8514-4f73ca0b25a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:58.161291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb20fd7-63e7-47dd-8514-4f73ca0b25a4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:58.171142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 912/1818] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:58.175462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04318bf-e263-4634-831c-023b86c7c053 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:58.189144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04318bf-e263-4634-831c-023b86c7c053 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:58.199885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220ea52-ab09-475e-8ac9-a46d9172f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:58.201126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220ea52-ab09-475e-8ac9-a46d9172f133 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:58.202422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220ea52-ab09-475e-8ac9-a46d9172f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:58.202422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220ea52-ab09-475e-8ac9-a46d9172f133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:58.203393 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220ea52-ab09-475e-8ac9-a46d9172f133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:58.205237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220ea52-ab09-475e-8ac9-a46d9172f133 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:58.222403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 907/1819] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:58.226953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb20fd7-63e7-47dd-8514-4f73ca0b25a4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:58.238328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb20fd7-63e7-47dd-8514-4f73ca0b25a4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:58.242952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3fa59-e464-4062-ab05-533435878325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:58.249793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fa59-e464-4062-ab05-533435878325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:58.249793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fa59-e464-4062-ab05-533435878325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:58.249793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fa59-e464-4062-ab05-533435878325 admin admin] PATH_INFO: `/v3/projects/c22ab2d251d34bc49a730454b1c07112/users/fb511a0188a244278bc04b75bb0fab1f/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:58.260358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3fa59-e464-4062-ab05-533435878325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22ab2d251d34bc49a730454b1c07112, user_id=fb511a0188a244278bc04b75bb0fab1f, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:58.263002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3fa59-e464-4062-ab05-533435878325 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:58.337440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 913/1820] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:58 2022] PUT /identity/v3/projects/c22ab2d251d34bc49a730454b1c07112/users/fb511a0188a244278bc04b75bb0fab1f/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:19:58.349972 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c552a00-7da9-4eeb-9b7c-88eb10f30285 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:58.350260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c552a00-7da9-4eeb-9b7c-88eb10f30285 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:58.350545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c552a00-7da9-4eeb-9b7c-88eb10f30285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:58.396279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3c552a00-7da9-4eeb-9b7c-88eb10f30285 None None] MFA Rules not processed for user `fb511a0188a244278bc04b75bb0fab1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:58.397513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c552a00-7da9-4eeb-9b7c-88eb10f30285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:58.479290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 908/1821] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:58.482905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3fa59-e464-4062-ab05-533435878325 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:58.563087 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3fa59-e464-4062-ab05-533435878325 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:58.567986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690ff16-960c-442d-8d06-5cb60b652021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:58.568626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690ff16-960c-442d-8d06-5cb60b652021 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:58.568910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690ff16-960c-442d-8d06-5cb60b652021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:58.570447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690ff16-960c-442d-8d06-5cb60b652021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:58.570447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690ff16-960c-442d-8d06-5cb60b652021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:58.571723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690ff16-960c-442d-8d06-5cb60b652021 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:58.655833 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 914/1822] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:58 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:19:58.657205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c552a00-7da9-4eeb-9b7c-88eb10f30285 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:58.668534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c552a00-7da9-4eeb-9b7c-88eb10f30285 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:58.756231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdb426-6596-47cc-af53-119d0bf68060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:58.756862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdb426-6596-47cc-af53-119d0bf68060 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:58.757142 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdb426-6596-47cc-af53-119d0bf68060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:58.757443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdb426-6596-47cc-af53-119d0bf68060 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:58.758087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdb426-6596-47cc-af53-119d0bf68060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:58.759989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdb426-6596-47cc-af53-119d0bf68060 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:58.873063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 909/1823] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:58 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:19:58.874939 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690ff16-960c-442d-8d06-5cb60b652021 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:58.885770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690ff16-960c-442d-8d06-5cb60b652021 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:58.890732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e3ea8-d880-49ba-9d07-b6bb46781fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:58.891344 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e3ea8-d880-49ba-9d07-b6bb46781fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:58.891626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e3ea8-d880-49ba-9d07-b6bb46781fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:58.891960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e3ea8-d880-49ba-9d07-b6bb46781fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:58.892651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e3ea8-d880-49ba-9d07-b6bb46781fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:58.894318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e3ea8-d880-49ba-9d07-b6bb46781fa3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:58.908560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 915/1824] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:58.909831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdb426-6596-47cc-af53-119d0bf68060 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:58.920340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdb426-6596-47cc-af53-119d0bf68060 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:58.925866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6a31f-aaf9-4f5a-ba66-7c5c387ebbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:58.937035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6a31f-aaf9-4f5a-ba66-7c5c387ebbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:58.937035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6a31f-aaf9-4f5a-ba66-7c5c387ebbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:58.937035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6a31f-aaf9-4f5a-ba66-7c5c387ebbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:58.937035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6a31f-aaf9-4f5a-ba66-7c5c387ebbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:58.937035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6a31f-aaf9-4f5a-ba66-7c5c387ebbf8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:58.937035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:58.940834 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 910/1825] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:58.952084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e3ea8-d880-49ba-9d07-b6bb46781fa3 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:58.962541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e3ea8-d880-49ba-9d07-b6bb46781fa3 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:58.967639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1276-8620-4041-896f-472df56a595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:58.968378 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1276-8620-4041-896f-472df56a595e admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:58.968663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1276-8620-4041-896f-472df56a595e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:58.968965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1276-8620-4041-896f-472df56a595e admin admin] PATH_INFO: `/v3/projects/b5ff830014f840009dd8c0380756a111/users/f3b447eccd384df287982dfdd5aa3620/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:58.987101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d1276-8620-4041-896f-472df56a595e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ff830014f840009dd8c0380756a111, user_id=f3b447eccd384df287982dfdd5aa3620, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:58.988572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d1276-8620-4041-896f-472df56a595e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:59.071281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 916/1826] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:58 2022] PUT /identity/v3/projects/b5ff830014f840009dd8c0380756a111/users/f3b447eccd384df287982dfdd5aa3620/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:59.082629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954faac2-7ab1-4753-8b5c-a1c58569f11d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:59.082914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954faac2-7ab1-4753-8b5c-a1c58569f11d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:59.083186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954faac2-7ab1-4753-8b5c-a1c58569f11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:59.114008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-954faac2-7ab1-4753-8b5c-a1c58569f11d None None] MFA Rules not processed for user `f3b447eccd384df287982dfdd5aa3620`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:19:59.115221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-954faac2-7ab1-4753-8b5c-a1c58569f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:19:59.184632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 911/1827] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:19:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:19:59.189516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1276-8620-4041-896f-472df56a595e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:59.256801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1276-8620-4041-896f-472df56a595e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:59.261577 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ea8a-a933-450b-99a7-5804140fc4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:59.262185 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ea8a-a933-450b-99a7-5804140fc4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:59.262464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ea8a-a933-450b-99a7-5804140fc4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:59.262744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312ea8a-a933-450b-99a7-5804140fc4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:59.263394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312ea8a-a933-450b-99a7-5804140fc4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:59.265360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312ea8a-a933-450b-99a7-5804140fc4b5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:59.390197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:19:59.398392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 917/1828] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:19:59 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:19:59.402953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954faac2-7ab1-4753-8b5c-a1c58569f11d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:59.424907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954faac2-7ab1-4753-8b5c-a1c58569f11d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:59.502244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40709bba-7df6-40ee-8eea-2cab89eac98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:59.502897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709bba-7df6-40ee-8eea-2cab89eac98a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:59.503179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709bba-7df6-40ee-8eea-2cab89eac98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:59.503455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709bba-7df6-40ee-8eea-2cab89eac98a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:59.504108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40709bba-7df6-40ee-8eea-2cab89eac98a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:59.506068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40709bba-7df6-40ee-8eea-2cab89eac98a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:59.629127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 912/1829] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:19:59 2022] POST /identity/v3/users => generated 299 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:19:59.633076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ea8a-a933-450b-99a7-5804140fc4b5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:59.644831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312ea8a-a933-450b-99a7-5804140fc4b5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:59.659579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb3774-4838-490a-a802-7dad633558a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:59.660467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb3774-4838-490a-a802-7dad633558a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:59.661114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb3774-4838-490a-a802-7dad633558a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:59.661528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb3774-4838-490a-a802-7dad633558a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:59.662322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb3774-4838-490a-a802-7dad633558a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:59.664121 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb3774-4838-490a-a802-7dad633558a2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:59.694610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 918/1830] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:19:59.698610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40709bba-7df6-40ee-8eea-2cab89eac98a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:59.721888 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40709bba-7df6-40ee-8eea-2cab89eac98a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:59.728918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d862c18-fc1d-4d64-9e8d-ca2148566799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:19:59.729880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862c18-fc1d-4d64-9e8d-ca2148566799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:19:59.730279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862c18-fc1d-4d64-9e8d-ca2148566799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:19:59.730618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862c18-fc1d-4d64-9e8d-ca2148566799 admin admin] PATH_INFO: `/v3/projects/ca1cb8b037c144a399585c24bc3038e9/users/ab119eb097e24d699a85f6b004baa144/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:19:59.778642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d862c18-fc1d-4d64-9e8d-ca2148566799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1cb8b037c144a399585c24bc3038e9, user_id=ab119eb097e24d699a85f6b004baa144, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:19:59.783515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d862c18-fc1d-4d64-9e8d-ca2148566799 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:19:59.884327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 913/1831] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:19:59 2022] PUT /identity/v3/projects/ca1cb8b037c144a399585c24bc3038e9/users/ab119eb097e24d699a85f6b004baa144/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:19:59.888021 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb3774-4838-490a-a802-7dad633558a2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:59.898752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb3774-4838-490a-a802-7dad633558a2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:19:59.982201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d862c18-fc1d-4d64-9e8d-ca2148566799 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:19:59.991575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d862c18-fc1d-4d64-9e8d-ca2148566799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:00.067703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd7494-61aa-4ed2-be2e-e7893a37a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:00.068522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd7494-61aa-4ed2-be2e-e7893a37a259 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:00.068807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd7494-61aa-4ed2-be2e-e7893a37a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:00.069234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd7494-61aa-4ed2-be2e-e7893a37a259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:00.069915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd7494-61aa-4ed2-be2e-e7893a37a259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:00.076170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd7494-61aa-4ed2-be2e-e7893a37a259 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:00.116863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 919/1832] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:20:00.121143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd7494-61aa-4ed2-be2e-e7893a37a259 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:00.140660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd7494-61aa-4ed2-be2e-e7893a37a259 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:00.159450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4875eb-324a-412b-82ed-bce1435ba72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:00.160530 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4875eb-324a-412b-82ed-bce1435ba72a admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:00.160957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4875eb-324a-412b-82ed-bce1435ba72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:00.161378 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4875eb-324a-412b-82ed-bce1435ba72a admin admin] PATH_INFO: `/v3/projects/ca1cb8b037c144a399585c24bc3038e9/users/ab119eb097e24d699a85f6b004baa144/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:00.163582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4875eb-324a-412b-82ed-bce1435ba72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1cb8b037c144a399585c24bc3038e9, user_id=ab119eb097e24d699a85f6b004baa144, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:00.167930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4875eb-324a-412b-82ed-bce1435ba72a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:00.185434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 920/1833] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:00 2022] PUT /identity/v3/projects/ca1cb8b037c144a399585c24bc3038e9/users/ab119eb097e24d699a85f6b004baa144/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:00.195391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9f413-6bb1-46c3-a6b9-ff0a72c50d58 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:00.195926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9f413-6bb1-46c3-a6b9-ff0a72c50d58 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:00.196554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9f413-6bb1-46c3-a6b9-ff0a72c50d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:00.197745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:00.206435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d862c18-fc1d-4d64-9e8d-ca2148566799 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:00.262188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1ac9f413-6bb1-46c3-a6b9-ff0a72c50d58 None None] MFA Rules not processed for user `ab119eb097e24d699a85f6b004baa144`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:00.266497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1ac9f413-6bb1-46c3-a6b9-ff0a72c50d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:00.340634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:00.341643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:00.342043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:00.342254 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] PATH_INFO: `/v3/users/94ae3391b37840dfb2987695d8381941` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:00.344294 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ae3391b37840dfb2987695d8381941)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:00.346799 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:00.379201 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 921/1834] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:00.391480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9f413-6bb1-46c3-a6b9-ff0a72c50d58 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:00.393707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1ac9f413-6bb1-46c3-a6b9-ff0a72c50d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:00.455690 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9f413-6bb1-46c3-a6b9-ff0a72c50d58 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:00.459408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c991e3d-641f-43e2-9f18-0c853dc26d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:00.460025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c991e3d-641f-43e2-9f18-0c853dc26d0c service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:00.460335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c991e3d-641f-43e2-9f18-0c853dc26d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:00.460611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c991e3d-641f-43e2-9f18-0c853dc26d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:00.469909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:00.523615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c991e3d-641f-43e2-9f18-0c853dc26d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:00.525138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c991e3d-641f-43e2-9f18-0c853dc26d0c service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:00.536975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 922/1835] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:20:00.656463 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ae3391b37840dfb2987695d8381941'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:00.666966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ae3391b37840dfb2987695d8381941'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:00.754553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ae3391b37840dfb2987695d8381941'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:00.755286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ae3391b37840dfb2987695d8381941'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:00.755874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ae3391b37840dfb2987695d8381941'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:00.776318 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 914/1836] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:19:59 2022] DELETE /identity/v3/users/94ae3391b37840dfb2987695d8381941 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:00.781474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1fce0-2e04-4a11-a7f7-9bd99442f208 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:00.782339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1fce0-2e04-4a11-a7f7-9bd99442f208 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:00.783283 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1fce0-2e04-4a11-a7f7-9bd99442f208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:00.807635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d5b1fce0-2e04-4a11-a7f7-9bd99442f208 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:00.809427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d5b1fce0-2e04-4a11-a7f7-9bd99442f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:00.891551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 923/1837] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:00.901312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:00.902788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:00.980730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7621d5-848a-484a-9a90-b81e91ce0db7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:00.985363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40465f79-cac9-40f5-a5bf-87759475c300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:00.986045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40465f79-cac9-40f5-a5bf-87759475c300 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:00.986332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40465f79-cac9-40f5-a5bf-87759475c300 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:00.986615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40465f79-cac9-40f5-a5bf-87759475c300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:00.997489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40465f79-cac9-40f5-a5bf-87759475c300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:00.999774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40465f79-cac9-40f5-a5bf-87759475c300 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:01.012395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 915/1838] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:01.624811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1fce0-2e04-4a11-a7f7-9bd99442f208 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:01.627730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d5b1fce0-2e04-4a11-a7f7-9bd99442f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:01.640492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1fce0-2e04-4a11-a7f7-9bd99442f208 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:01.645575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:01.646552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:01.646835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:01.647110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] PATH_INFO: `/v3/projects/5fa5edd103a44a06996542a08b608647` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:01.648315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa5edd103a44a06996542a08b608647)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:01.650209 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:01.750893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa5edd103a44a06996542a08b608647', 'request_id': 'req-a9ce49a7-faab-425c-a877-f4341947395b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:01.757163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa5edd103a44a06996542a08b608647', 'request_id': 'req-a9ce49a7-faab-425c-a877-f4341947395b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:01.846303 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa5edd103a44a06996542a08b608647', 'request_id': 'req-a9ce49a7-faab-425c-a877-f4341947395b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:01.867646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] The token cache is being invalidate because project 5fa5edd103a44a06996542a08b608647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:01.868363 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:01.869409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:01.871090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 924/1839] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:01 2022] DELETE /identity/v3/projects/5fa5edd103a44a06996542a08b608647 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:01.876606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40465f79-cac9-40f5-a5bf-87759475c300 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:01.887182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40465f79-cac9-40f5-a5bf-87759475c300 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:01.911296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:01.952480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:01.953131 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:01.953411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:01.953692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] PATH_INFO: `/v3/users/f2b27403c9864181b41658e954f41be1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:01.954846 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b27403c9864181b41658e954f41be1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:01.956886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:02.163566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b27403c9864181b41658e954f41be1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:02.172078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b27403c9864181b41658e954f41be1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:02.291950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b27403c9864181b41658e954f41be1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:02.292626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b27403c9864181b41658e954f41be1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:02.293249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b27403c9864181b41658e954f41be1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:02.311753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 916/1840] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:01 2022] DELETE /identity/v3/users/f2b27403c9864181b41658e954f41be1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:02.763240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:02.765729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:02.780737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce49a7-faab-425c-a877-f4341947395b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:02.818667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:02.855920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:02.857370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:02.857656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:02.861794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] PATH_INFO: `/v3/projects/049199fed7d443f98693f00ad292ec0d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:02.861794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049199fed7d443f98693f00ad292ec0d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:02.861794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:03.000044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049199fed7d443f98693f00ad292ec0d', 'request_id': 'req-af8378d6-1718-4b1c-9c1a-6567f76dfc55'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:03.008734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049199fed7d443f98693f00ad292ec0d', 'request_id': 'req-af8378d6-1718-4b1c-9c1a-6567f76dfc55'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:03.080521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049199fed7d443f98693f00ad292ec0d', 'request_id': 'req-af8378d6-1718-4b1c-9c1a-6567f76dfc55'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:03.093264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] The token cache is being invalidate because project 049199fed7d443f98693f00ad292ec0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:03.095381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:03.095924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:03.100755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 925/1841] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:02 2022] DELETE /identity/v3/projects/049199fed7d443f98693f00ad292ec0d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:03.102043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:03.103579 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:03.117060 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd200c-88f2-4294-a4e8-fd06736cadb0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:03.189836 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:03.191352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:03.191638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:03.191920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] PATH_INFO: `/v3/users/9d559166f3e74adcbfc48674860ad81d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:03.193388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d559166f3e74adcbfc48674860ad81d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:03.195488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:03.414108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:03.416178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d559166f3e74adcbfc48674860ad81d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:03.424456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d559166f3e74adcbfc48674860ad81d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:03.503305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d559166f3e74adcbfc48674860ad81d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:03.503931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d559166f3e74adcbfc48674860ad81d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:03.504558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d559166f3e74adcbfc48674860ad81d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:03.523681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 917/1842] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:03 2022] DELETE /identity/v3/users/9d559166f3e74adcbfc48674860ad81d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:03.853565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:03.854988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:03.924742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8378d6-1718-4b1c-9c1a-6567f76dfc55 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:03.982233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4df7d1-8247-484c-a4a2-cd47fb415a0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:03.983041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4df7d1-8247-484c-a4a2-cd47fb415a0e service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:03.983949 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4df7d1-8247-484c-a4a2-cd47fb415a0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:03.984707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4df7d1-8247-484c-a4a2-cd47fb415a0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:03.986135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ac4df7d1-8247-484c-a4a2-cd47fb415a0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:04.022268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:04.048871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4df7d1-8247-484c-a4a2-cd47fb415a0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:04.050300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4df7d1-8247-484c-a4a2-cd47fb415a0e service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:04.059096 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 926/1843] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:04.087467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:04.088817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:04.165193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c78aa7-47fd-446e-979c-09a8de20151b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:04.169953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:04.170537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:04.171744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:04.171744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] PATH_INFO: `/v3/projects/5a121c0e4f134f25816b470ccc2e9049` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:04.172829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a121c0e4f134f25816b470ccc2e9049)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:04.176968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:04.379868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a121c0e4f134f25816b470ccc2e9049', 'request_id': 'req-2789e2cb-f705-4859-a9dd-9c04d96d4392'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:04.386779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a121c0e4f134f25816b470ccc2e9049', 'request_id': 'req-2789e2cb-f705-4859-a9dd-9c04d96d4392'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:04.392977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a121c0e4f134f25816b470ccc2e9049', 'request_id': 'req-2789e2cb-f705-4859-a9dd-9c04d96d4392'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:04.469856 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] The token cache is being invalidate because project 5a121c0e4f134f25816b470ccc2e9049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:04.470468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:04.471590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2789e2cb-f705-4859-a9dd-9c04d96d4392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:04.473562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 918/1844] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:04 2022] DELETE /identity/v3/projects/5a121c0e4f134f25816b470ccc2e9049 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:04.479599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d7690-bf9d-483b-a8f5-3691126761b6 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:04.479883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d7690-bf9d-483b-a8f5-3691126761b6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:04.480237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d7690-bf9d-483b-a8f5-3691126761b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:04.502913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-848d7690-bf9d-483b-a8f5-3691126761b6 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:04.504255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-848d7690-bf9d-483b-a8f5-3691126761b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:04.588248 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 927/1845] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:04.596036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d49d4-8b2c-4135-8a01-b464b460851b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:04.596360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d49d4-8b2c-4135-8a01-b464b460851b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:04.596643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d49d4-8b2c-4135-8a01-b464b460851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:04.618575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-af7d49d4-8b2c-4135-8a01-b464b460851b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:04.620464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af7d49d4-8b2c-4135-8a01-b464b460851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:04.644089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 919/1846] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:04.659639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d7690-bf9d-483b-a8f5-3691126761b6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:04.670004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d7690-bf9d-483b-a8f5-3691126761b6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:04.675831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e906-1c4a-418e-a7d8-9d7d3c2048ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:04.676610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e906-1c4a-418e-a7d8-9d7d3c2048ca admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:04.676873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e906-1c4a-418e-a7d8-9d7d3c2048ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:04.677151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e906-1c4a-418e-a7d8-9d7d3c2048ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:04.677810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29e906-1c4a-418e-a7d8-9d7d3c2048ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:20:04.678114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29e906-1c4a-418e-a7d8-9d7d3c2048ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:04.679744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29e906-1c4a-418e-a7d8-9d7d3c2048ca admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:04.704070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 928/1847] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:20:04.705336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d49d4-8b2c-4135-8a01-b464b460851b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:04.715917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d49d4-8b2c-4135-8a01-b464b460851b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:04.723018 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3da5a5-855a-427a-be5c-afa933078c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:04.723638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da5a5-855a-427a-be5c-afa933078c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:04.723924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da5a5-855a-427a-be5c-afa933078c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:04.724495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da5a5-855a-427a-be5c-afa933078c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:04.725161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3da5a5-855a-427a-be5c-afa933078c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:04.727092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3da5a5-855a-427a-be5c-afa933078c17 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:04.831594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 920/1848] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:20:04 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:04.835696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e906-1c4a-418e-a7d8-9d7d3c2048ca admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:04.846980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e906-1c4a-418e-a7d8-9d7d3c2048ca admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:04.904868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3d500-54c5-4c46-8d37-87cbe227787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:04.905476 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3d500-54c5-4c46-8d37-87cbe227787f admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:04.905760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3d500-54c5-4c46-8d37-87cbe227787f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:04.906037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3d500-54c5-4c46-8d37-87cbe227787f admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:04.907329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3d500-54c5-4c46-8d37-87cbe227787f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:04.909437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3d500-54c5-4c46-8d37-87cbe227787f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:05.014845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 929/1849] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:20:04 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:20:05.019868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3da5a5-855a-427a-be5c-afa933078c17 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:05.030779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3da5a5-855a-427a-be5c-afa933078c17 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:05.035805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b62f4-9ec8-4a59-b120-6c65ff6be92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:05.036463 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b62f4-9ec8-4a59-b120-6c65ff6be92b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:05.036745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b62f4-9ec8-4a59-b120-6c65ff6be92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:05.037022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b62f4-9ec8-4a59-b120-6c65ff6be92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:05.041031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b62f4-9ec8-4a59-b120-6c65ff6be92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:05.041031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b62f4-9ec8-4a59-b120-6c65ff6be92b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:05.057427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 921/1850] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:05.058105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3d500-54c5-4c46-8d37-87cbe227787f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:05.072526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3d500-54c5-4c46-8d37-87cbe227787f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:05.077663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420eb1e2-4c95-45e9-a391-edc2c52f1665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:05.078431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eb1e2-4c95-45e9-a391-edc2c52f1665 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:05.079162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eb1e2-4c95-45e9-a391-edc2c52f1665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:05.079601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420eb1e2-4c95-45e9-a391-edc2c52f1665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:05.080355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eb1e2-4c95-45e9-a391-edc2c52f1665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:05.082100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420eb1e2-4c95-45e9-a391-edc2c52f1665 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:05.093949 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 930/1851] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:05.098260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b62f4-9ec8-4a59-b120-6c65ff6be92b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:05.109484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b62f4-9ec8-4a59-b120-6c65ff6be92b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:05.114405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e2800-65d3-413e-b94b-8d944eda0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:05.115130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e2800-65d3-413e-b94b-8d944eda0f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:05.115594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e2800-65d3-413e-b94b-8d944eda0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:05.115881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e2800-65d3-413e-b94b-8d944eda0f06 admin admin] PATH_INFO: `/v3/projects/49b0c9b1afa94007b6d407f8339c2ac4/users/23459c701973458d91cb3d98778433c0/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:05.129007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:05.133165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e2800-65d3-413e-b94b-8d944eda0f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b0c9b1afa94007b6d407f8339c2ac4, user_id=23459c701973458d91cb3d98778433c0, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:05.135992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e2800-65d3-413e-b94b-8d944eda0f06 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:05.253032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 922/1852] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:05 2022] PUT /identity/v3/projects/49b0c9b1afa94007b6d407f8339c2ac4/users/23459c701973458d91cb3d98778433c0/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:20:05.265237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc3b82-ab92-4081-bdf9-72113f69e13e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:05.265528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc3b82-ab92-4081-bdf9-72113f69e13e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:05.265806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc3b82-ab92-4081-bdf9-72113f69e13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:05.294678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-87bc3b82-ab92-4081-bdf9-72113f69e13e None None] MFA Rules not processed for user `23459c701973458d91cb3d98778433c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:05.295916 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-87bc3b82-ab92-4081-bdf9-72113f69e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:05.332235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:05.368984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 931/1853] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:05.373786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e2800-65d3-413e-b94b-8d944eda0f06 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:05.438946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e2800-65d3-413e-b94b-8d944eda0f06 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:05.443906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175957d-c90f-48ed-9575-b0aad68bb1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:05.444542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175957d-c90f-48ed-9575-b0aad68bb1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:05.444826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175957d-c90f-48ed-9575-b0aad68bb1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:05.445102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175957d-c90f-48ed-9575-b0aad68bb1e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:05.445736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175957d-c90f-48ed-9575-b0aad68bb1e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:05.447903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175957d-c90f-48ed-9575-b0aad68bb1e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:05.555919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 923/1854] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:20:05 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:05.558900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc3b82-ab92-4081-bdf9-72113f69e13e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:05.597895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc3b82-ab92-4081-bdf9-72113f69e13e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:05.738660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ca72b-01b4-409b-a6e8-7bb3e2e0d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:05.739599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ca72b-01b4-409b-a6e8-7bb3e2e0d33c admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:05.739942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ca72b-01b4-409b-a6e8-7bb3e2e0d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:05.740322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ca72b-01b4-409b-a6e8-7bb3e2e0d33c admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:05.741044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ca72b-01b4-409b-a6e8-7bb3e2e0d33c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:05.744706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ca72b-01b4-409b-a6e8-7bb3e2e0d33c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:05.804237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175957d-c90f-48ed-9575-b0aad68bb1e9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:05.806271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5175957d-c90f-48ed-9575-b0aad68bb1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:05.873998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 932/1855] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:20:05 2022] POST /identity/v3/users => generated 299 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:05.874852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175957d-c90f-48ed-9575-b0aad68bb1e9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:05.881854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ca72b-01b4-409b-a6e8-7bb3e2e0d33c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:05.887840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9ff09-360b-4c88-91d5-6b6296686ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:05.888550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9ff09-360b-4c88-91d5-6b6296686ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:05.888845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9ff09-360b-4c88-91d5-6b6296686ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:05.889139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9ff09-360b-4c88-91d5-6b6296686ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:05.891868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fee9ff09-360b-4c88-91d5-6b6296686ec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:05.895459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ca72b-01b4-409b-a6e8-7bb3e2e0d33c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:05.905792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe9f5b-e85b-45ca-b6a5-fff0bfc00970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:05.907050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe9f5b-e85b-45ca-b6a5-fff0bfc00970 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:05.907735 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe9f5b-e85b-45ca-b6a5-fff0bfc00970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:05.911219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe9f5b-e85b-45ca-b6a5-fff0bfc00970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:05.911219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe9f5b-e85b-45ca-b6a5-fff0bfc00970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:05.911489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe9f5b-e85b-45ca-b6a5-fff0bfc00970 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:05.944376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 933/1856] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:05.947574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe9f5b-e85b-45ca-b6a5-fff0bfc00970 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:05.967529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe9f5b-e85b-45ca-b6a5-fff0bfc00970 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:05.980886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52554f2-1c30-4c2c-8d73-3a9cc5921eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:05.981944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52554f2-1c30-4c2c-8d73-3a9cc5921eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:05.982647 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52554f2-1c30-4c2c-8d73-3a9cc5921eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:05.983943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52554f2-1c30-4c2c-8d73-3a9cc5921eb7 admin admin] PATH_INFO: `/v3/projects/3d3abe04a81a4fcaa53ab8e42fbf6108/users/9b7de3df7b9e498b8d52bc7951ceca67/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:05.998134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9ff09-360b-4c88-91d5-6b6296686ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:06.002558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9ff09-360b-4c88-91d5-6b6296686ec3 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:06.020113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52554f2-1c30-4c2c-8d73-3a9cc5921eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3abe04a81a4fcaa53ab8e42fbf6108, user_id=9b7de3df7b9e498b8d52bc7951ceca67, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:06.024138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52554f2-1c30-4c2c-8d73-3a9cc5921eb7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:06.033884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 924/1857] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:20:06.101196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 934/1858] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:05 2022] PUT /identity/v3/projects/3d3abe04a81a4fcaa53ab8e42fbf6108/users/9b7de3df7b9e498b8d52bc7951ceca67/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:06.102794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9ff09-360b-4c88-91d5-6b6296686ec3 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:06.113793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9ff09-360b-4c88-91d5-6b6296686ec3 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:06.144410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:06.181806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d33928-94e2-4533-8b82-b39509c4e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:06.182422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33928-94e2-4533-8b82-b39509c4e0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:06.182699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33928-94e2-4533-8b82-b39509c4e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:06.182978 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33928-94e2-4533-8b82-b39509c4e0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:06.183622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d33928-94e2-4533-8b82-b39509c4e0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:06.185404 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d33928-94e2-4533-8b82-b39509c4e0e5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:06.196487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 925/1859] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:06.200816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52554f2-1c30-4c2c-8d73-3a9cc5921eb7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:06.211824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52554f2-1c30-4c2c-8d73-3a9cc5921eb7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:06.216977 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62361bf2-1eaa-44ee-a970-c0d41c780f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:06.217717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62361bf2-1eaa-44ee-a970-c0d41c780f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:06.217997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62361bf2-1eaa-44ee-a970-c0d41c780f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:06.218269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62361bf2-1eaa-44ee-a970-c0d41c780f89 admin admin] PATH_INFO: `/v3/projects/3d3abe04a81a4fcaa53ab8e42fbf6108/users/9b7de3df7b9e498b8d52bc7951ceca67/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:06.220187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62361bf2-1eaa-44ee-a970-c0d41c780f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3abe04a81a4fcaa53ab8e42fbf6108, user_id=9b7de3df7b9e498b8d52bc7951ceca67, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:06.222971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62361bf2-1eaa-44ee-a970-c0d41c780f89 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:06.233802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 935/1860] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:06 2022] PUT /identity/v3/projects/3d3abe04a81a4fcaa53ab8e42fbf6108/users/9b7de3df7b9e498b8d52bc7951ceca67/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:20:06.244661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6c9e4-6de9-4986-a722-024ad3770283 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:06.244949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6c9e4-6de9-4986-a722-024ad3770283 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:06.245222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6c9e4-6de9-4986-a722-024ad3770283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:06.279178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-62d6c9e4-6de9-4986-a722-024ad3770283 None None] MFA Rules not processed for user `9b7de3df7b9e498b8d52bc7951ceca67`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:06.279178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-62d6c9e4-6de9-4986-a722-024ad3770283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:06.386408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 926/1861] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:06.398158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62361bf2-1eaa-44ee-a970-c0d41c780f89 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:06.464065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62361bf2-1eaa-44ee-a970-c0d41c780f89 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:06.467805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde8ba5-0ad5-4960-98e6-adb326dee925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:06.468453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde8ba5-0ad5-4960-98e6-adb326dee925 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:06.468788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde8ba5-0ad5-4960-98e6-adb326dee925 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:06.469068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde8ba5-0ad5-4960-98e6-adb326dee925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:06.493899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:06.526546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde8ba5-0ad5-4960-98e6-adb326dee925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:06.528028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde8ba5-0ad5-4960-98e6-adb326dee925 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:06.537643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 936/1862] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:07.993604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692840da-2f91-4892-8ac5-8c18568bd510 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:07.994172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692840da-2f91-4892-8ac5-8c18568bd510 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:07.994482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692840da-2f91-4892-8ac5-8c18568bd510 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:07.996035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 927/1863] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:20:08.021008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cebc7c-c538-4374-ac3f-3df9657e21d9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:08.021695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cebc7c-c538-4374-ac3f-3df9657e21d9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:08.021943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cebc7c-c538-4374-ac3f-3df9657e21d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:08.043149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-55cebc7c-c538-4374-ac3f-3df9657e21d9 None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:08.044903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-55cebc7c-c538-4374-ac3f-3df9657e21d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:08.213786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 937/1864] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:08.869009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692840da-2f91-4892-8ac5-8c18568bd510 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:08.871356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-692840da-2f91-4892-8ac5-8c18568bd510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:08.918370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692840da-2f91-4892-8ac5-8c18568bd510 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:08.927852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f72d9-7141-4ba0-a1a7-387fe02d0d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:08.928603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f72d9-7141-4ba0-a1a7-387fe02d0d95 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:08.929162 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f72d9-7141-4ba0-a1a7-387fe02d0d95 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:08.929508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f72d9-7141-4ba0-a1a7-387fe02d0d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:08.945371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f72d9-7141-4ba0-a1a7-387fe02d0d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:08.947276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f72d9-7141-4ba0-a1a7-387fe02d0d95 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:08.963023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 928/1865] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:13.075726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cebc7c-c538-4374-ac3f-3df9657e21d9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:13.077188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-55cebc7c-c538-4374-ac3f-3df9657e21d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:13.153695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cebc7c-c538-4374-ac3f-3df9657e21d9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:13.158346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:13.159006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:13.159305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:13.159571 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] PATH_INFO: `/v3/users/fb511a0188a244278bc04b75bb0fab1f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:13.160732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb511a0188a244278bc04b75bb0fab1f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:13.162649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:13.408537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb511a0188a244278bc04b75bb0fab1f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:13.415840 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb511a0188a244278bc04b75bb0fab1f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:13.416677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb511a0188a244278bc04b75bb0fab1f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:13.419364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:13.492036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb511a0188a244278bc04b75bb0fab1f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:13.505475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb511a0188a244278bc04b75bb0fab1f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:13.512912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 938/1866] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:13 2022] DELETE /identity/v3/users/fb511a0188a244278bc04b75bb0fab1f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:13.517637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303d999-d5e7-4882-be6c-caaaa2247163 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:13.518172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303d999-d5e7-4882-be6c-caaaa2247163 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:13.518172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303d999-d5e7-4882-be6c-caaaa2247163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:13.538488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f303d999-d5e7-4882-be6c-caaaa2247163 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:13.539683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f303d999-d5e7-4882-be6c-caaaa2247163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:13.601449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 929/1867] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:13.611888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:13.613777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:13.672100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebabfdb-f317-488a-bf9a-2a9c87edda22 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:13.675744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4791630-e4cc-4dc4-8125-17f17a91dc25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:13.676390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791630-e4cc-4dc4-8125-17f17a91dc25 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:13.676665 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791630-e4cc-4dc4-8125-17f17a91dc25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:13.676933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791630-e4cc-4dc4-8125-17f17a91dc25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:13.686489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4791630-e4cc-4dc4-8125-17f17a91dc25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:13.688533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4791630-e4cc-4dc4-8125-17f17a91dc25 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:13.697627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 939/1868] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:13.822265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303d999-d5e7-4882-be6c-caaaa2247163 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:13.823968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f303d999-d5e7-4882-be6c-caaaa2247163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:13.868085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:13.892703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303d999-d5e7-4882-be6c-caaaa2247163 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:13.896762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85269e88-18de-4206-98af-ccaeb4fc4ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:13.905025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85269e88-18de-4206-98af-ccaeb4fc4ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:13.905025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85269e88-18de-4206-98af-ccaeb4fc4ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:13.905025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85269e88-18de-4206-98af-ccaeb4fc4ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:13.905025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-85269e88-18de-4206-98af-ccaeb4fc4ca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:13.973700 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85269e88-18de-4206-98af-ccaeb4fc4ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:13.975203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85269e88-18de-4206-98af-ccaeb4fc4ca9 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:13.991576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 930/1869] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:14.323454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4791630-e4cc-4dc4-8125-17f17a91dc25 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:14.331383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e4791630-e4cc-4dc4-8125-17f17a91dc25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:14.347914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4791630-e4cc-4dc4-8125-17f17a91dc25 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:14.354652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:14.355296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:14.355631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:14.355916 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] PATH_INFO: `/v3/projects/c22ab2d251d34bc49a730454b1c07112` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:14.357147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22ab2d251d34bc49a730454b1c07112)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:14.359113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:14.463973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22ab2d251d34bc49a730454b1c07112', 'request_id': 'req-4e358dab-c247-4a1b-96f6-a0544c01c309'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:14.470119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22ab2d251d34bc49a730454b1c07112', 'request_id': 'req-4e358dab-c247-4a1b-96f6-a0544c01c309'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:14.634760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22ab2d251d34bc49a730454b1c07112', 'request_id': 'req-4e358dab-c247-4a1b-96f6-a0544c01c309'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:14.646097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] The token cache is being invalidate because project c22ab2d251d34bc49a730454b1c07112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:14.646430 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:14.647064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:14.649312 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 940/1870] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:14 2022] DELETE /identity/v3/projects/c22ab2d251d34bc49a730454b1c07112 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:14.653608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85269e88-18de-4206-98af-ccaeb4fc4ca9 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:14.664570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85269e88-18de-4206-98af-ccaeb4fc4ca9 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:14.730587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:14.731271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:14.731558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:14.731836 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] PATH_INFO: `/v3/users/f3b447eccd384df287982dfdd5aa3620` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:14.733005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b447eccd384df287982dfdd5aa3620)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:14.736465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:14.987198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b447eccd384df287982dfdd5aa3620'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:14.994494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b447eccd384df287982dfdd5aa3620'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:15.057742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b447eccd384df287982dfdd5aa3620'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:15.058391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b447eccd384df287982dfdd5aa3620'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:15.059128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b447eccd384df287982dfdd5aa3620'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:15.077106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 931/1871] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:14 2022] DELETE /identity/v3/users/f3b447eccd384df287982dfdd5aa3620 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:16.078258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:16.081046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:16.121491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e358dab-c247-4a1b-96f6-a0544c01c309 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:16.207913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:16.207913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:16.207913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:16.207913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] PATH_INFO: `/v3/projects/b5ff830014f840009dd8c0380756a111` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:16.210199 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ff830014f840009dd8c0380756a111)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:16.212382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:16.215594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:16.392929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ff830014f840009dd8c0380756a111', 'request_id': 'req-d7933813-bb22-4419-ad8d-be62d9e31f45'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:16.411691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ff830014f840009dd8c0380756a111', 'request_id': 'req-d7933813-bb22-4419-ad8d-be62d9e31f45'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:16.509581 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ff830014f840009dd8c0380756a111', 'request_id': 'req-d7933813-bb22-4419-ad8d-be62d9e31f45'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:16.526832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] The token cache is being invalidate because project b5ff830014f840009dd8c0380756a111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:16.527130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:16.528463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:16.530067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 941/1872] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:16 2022] DELETE /identity/v3/projects/b5ff830014f840009dd8c0380756a111 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:16.534072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:16.536621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:16.544864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:16.550577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc73167-1706-4915-9e4b-3346bfdac6f4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:16.624596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:16.626107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:16.626524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:16.626811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] PATH_INFO: `/v3/users/ab119eb097e24d699a85f6b004baa144` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:16.628138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab119eb097e24d699a85f6b004baa144)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:16.630449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:16.896329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab119eb097e24d699a85f6b004baa144'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:16.904960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab119eb097e24d699a85f6b004baa144'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:17.023898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab119eb097e24d699a85f6b004baa144'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:17.025071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab119eb097e24d699a85f6b004baa144'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:17.027269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5de43396-ed02-4918-8c1e-3816eee67328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab119eb097e24d699a85f6b004baa144'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:17.068335 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 932/1873] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:16 2022] DELETE /identity/v3/users/ab119eb097e24d699a85f6b004baa144 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:20:17.551243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:17.552785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:17.567928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933813-bb22-4419-ad8d-be62d9e31f45 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:17.629296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:17.629943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:17.630283 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:17.630486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] PATH_INFO: `/v3/projects/ca1cb8b037c144a399585c24bc3038e9` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:17.631646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1cb8b037c144a399585c24bc3038e9)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:17.633610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:17.814474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1cb8b037c144a399585c24bc3038e9', 'request_id': 'req-00210495-c1d5-488e-94e1-66dd47c4234f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:17.820976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1cb8b037c144a399585c24bc3038e9', 'request_id': 'req-00210495-c1d5-488e-94e1-66dd47c4234f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:17.949348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1cb8b037c144a399585c24bc3038e9', 'request_id': 'req-00210495-c1d5-488e-94e1-66dd47c4234f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:17.961661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] The token cache is being invalidate because project ca1cb8b037c144a399585c24bc3038e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:17.961945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:17.962591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-00210495-c1d5-488e-94e1-66dd47c4234f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:17.964159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 942/1874] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:17 2022] DELETE /identity/v3/projects/ca1cb8b037c144a399585c24bc3038e9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:20:17.970211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8dda1-24ad-4b07-b863-14ab2b3b0019 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:17.970721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8dda1-24ad-4b07-b863-14ab2b3b0019 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:17.970810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8dda1-24ad-4b07-b863-14ab2b3b0019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:17.993257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3fb8dda1-24ad-4b07-b863-14ab2b3b0019 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:17.994477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3fb8dda1-24ad-4b07-b863-14ab2b3b0019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:18.080600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 933/1875] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:18.089073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d8df7-0450-4f98-85a1-1f49667839fb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:18.089355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d8df7-0450-4f98-85a1-1f49667839fb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:18.089741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d8df7-0450-4f98-85a1-1f49667839fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:18.120358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d42d8df7-0450-4f98-85a1-1f49667839fb None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:18.121843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d42d8df7-0450-4f98-85a1-1f49667839fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:18.131802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 943/1876] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:18.137310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8dda1-24ad-4b07-b863-14ab2b3b0019 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:18.149406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8dda1-24ad-4b07-b863-14ab2b3b0019 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:18.157234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3b415-d3fa-4455-ae39-a6f8c0823c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:18.158114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3b415-d3fa-4455-ae39-a6f8c0823c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:18.158569 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3b415-d3fa-4455-ae39-a6f8c0823c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:18.159234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3b415-d3fa-4455-ae39-a6f8c0823c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:18.160166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3b415-d3fa-4455-ae39-a6f8c0823c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:20:18.160659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3b415-d3fa-4455-ae39-a6f8c0823c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:18.162561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3b415-d3fa-4455-ae39-a6f8c0823c38 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:18.184726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 934/1877] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:20:18.185593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d8df7-0450-4f98-85a1-1f49667839fb None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:18.196323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d8df7-0450-4f98-85a1-1f49667839fb None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:18.202417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7287d9-78de-4494-bf60-6769e87c3b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:18.202417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7287d9-78de-4494-bf60-6769e87c3b77 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:18.202683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7287d9-78de-4494-bf60-6769e87c3b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:18.202758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7287d9-78de-4494-bf60-6769e87c3b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:18.203400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7287d9-78de-4494-bf60-6769e87c3b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:18.205386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7287d9-78de-4494-bf60-6769e87c3b77 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:18.224507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:18.323367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 944/1878] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:20:18 2022] POST /identity/v3/projects => generated 391 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:20:18.327712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3b415-d3fa-4455-ae39-a6f8c0823c38 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:18.340671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3b415-d3fa-4455-ae39-a6f8c0823c38 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:18.346689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:18.416993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c29799-e27a-4120-8f29-76c2df5f0706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:18.418039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c29799-e27a-4120-8f29-76c2df5f0706 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:18.418484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c29799-e27a-4120-8f29-76c2df5f0706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:18.418765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c29799-e27a-4120-8f29-76c2df5f0706 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:18.419792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c29799-e27a-4120-8f29-76c2df5f0706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:18.422175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c29799-e27a-4120-8f29-76c2df5f0706 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:18.523215 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 935/1879] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:20:18 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:18.543280 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7287d9-78de-4494-bf60-6769e87c3b77 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:18.546473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7287d9-78de-4494-bf60-6769e87c3b77 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:18.555520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30a707-bb5d-4940-a1ed-5062bbf4b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:18.556267 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30a707-bb5d-4940-a1ed-5062bbf4b908 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:18.556494 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30a707-bb5d-4940-a1ed-5062bbf4b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:18.557123 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30a707-bb5d-4940-a1ed-5062bbf4b908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:18.557491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30a707-bb5d-4940-a1ed-5062bbf4b908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:18.559701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30a707-bb5d-4940-a1ed-5062bbf4b908 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:18.575671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 945/1880] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:18.579901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c29799-e27a-4120-8f29-76c2df5f0706 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:18.593059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c29799-e27a-4120-8f29-76c2df5f0706 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:18.599825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ad4e5-a8be-4a51-bbfe-e7e63f45c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:18.600481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ad4e5-a8be-4a51-bbfe-e7e63f45c055 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:18.600907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ad4e5-a8be-4a51-bbfe-e7e63f45c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:18.601189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ad4e5-a8be-4a51-bbfe-e7e63f45c055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:18.601847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ad4e5-a8be-4a51-bbfe-e7e63f45c055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:18.603560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ad4e5-a8be-4a51-bbfe-e7e63f45c055 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:18.615789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 936/1881] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:18.620320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30a707-bb5d-4940-a1ed-5062bbf4b908 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:18.631547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30a707-bb5d-4940-a1ed-5062bbf4b908 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:18.636561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34feaaf-8b4e-42bc-aee1-950e4e9a30af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:18.637230 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34feaaf-8b4e-42bc-aee1-950e4e9a30af admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:18.637501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34feaaf-8b4e-42bc-aee1-950e4e9a30af admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:18.637773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34feaaf-8b4e-42bc-aee1-950e4e9a30af admin admin] PATH_INFO: `/v3/projects/9abdd67f3643446cbd6fa9ffa33ecbdf/users/bd71bbac0499407aa1b6b9738da540fc/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:18.653903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34feaaf-8b4e-42bc-aee1-950e4e9a30af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abdd67f3643446cbd6fa9ffa33ecbdf, user_id=bd71bbac0499407aa1b6b9738da540fc, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:18.657157 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34feaaf-8b4e-42bc-aee1-950e4e9a30af admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:18.743866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 946/1882] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:18 2022] PUT /identity/v3/projects/9abdd67f3643446cbd6fa9ffa33ecbdf/users/bd71bbac0499407aa1b6b9738da540fc/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:18.759866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993769b3-8f65-483d-9882-35dbe4f41098 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:18.760405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993769b3-8f65-483d-9882-35dbe4f41098 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:18.760692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993769b3-8f65-483d-9882-35dbe4f41098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:18.789114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-993769b3-8f65-483d-9882-35dbe4f41098 None None] MFA Rules not processed for user `bd71bbac0499407aa1b6b9738da540fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:18.790321 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-993769b3-8f65-483d-9882-35dbe4f41098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:18.854242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 937/1883] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:18.866115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34feaaf-8b4e-42bc-aee1-950e4e9a30af admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:18.867936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e34feaaf-8b4e-42bc-aee1-950e4e9a30af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:18.931927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34feaaf-8b4e-42bc-aee1-950e4e9a30af admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:18.935559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe1c19-0751-40d7-bcb7-3c9028b37bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:18.936185 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1c19-0751-40d7-bcb7-3c9028b37bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:18.936567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1c19-0751-40d7-bcb7-3c9028b37bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:18.936928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1c19-0751-40d7-bcb7-3c9028b37bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:18.945653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe1c19-0751-40d7-bcb7-3c9028b37bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:18.947119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe1c19-0751-40d7-bcb7-3c9028b37bc9 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:18.956628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 947/1884] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:21.393424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993769b3-8f65-483d-9882-35dbe4f41098 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:21.397395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-993769b3-8f65-483d-9882-35dbe4f41098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:21.536485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993769b3-8f65-483d-9882-35dbe4f41098 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:21.541566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:21.542620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:21.543107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:21.543812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] PATH_INFO: `/v3/users/23459c701973458d91cb3d98778433c0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:21.545386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] RBAC: Authorizing `identity:delete_user(user_id=23459c701973458d91cb3d98778433c0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:21.547726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:21.575095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:21.857638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23459c701973458d91cb3d98778433c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:21.865137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23459c701973458d91cb3d98778433c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:21.938504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23459c701973458d91cb3d98778433c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:21.939454 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23459c701973458d91cb3d98778433c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:21.940182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23459c701973458d91cb3d98778433c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:21.964524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 938/1885] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:21 2022] DELETE /identity/v3/users/23459c701973458d91cb3d98778433c0 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:21.968118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9d9a1-1dc1-4942-9589-2dac00a0268e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:21.968678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9d9a1-1dc1-4942-9589-2dac00a0268e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:21.968767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9d9a1-1dc1-4942-9589-2dac00a0268e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:21.989275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7bd9d9a1-1dc1-4942-9589-2dac00a0268e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:21.990564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7bd9d9a1-1dc1-4942-9589-2dac00a0268e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:22.057257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 948/1886] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:20:22.067828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:22.069413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:22.131656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24174a19-ac9a-42ab-87c1-cd59592bf4de admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:22.135556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea75ab-18cd-4cf4-afc5-701e2266ab36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:22.136174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea75ab-18cd-4cf4-afc5-701e2266ab36 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:22.136563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea75ab-18cd-4cf4-afc5-701e2266ab36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:22.136827 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea75ab-18cd-4cf4-afc5-701e2266ab36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:22.146826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea75ab-18cd-4cf4-afc5-701e2266ab36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:22.148874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea75ab-18cd-4cf4-afc5-701e2266ab36 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:22.158297 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 939/1887] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:22.910988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9d9a1-1dc1-4942-9589-2dac00a0268e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:22.913637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7bd9d9a1-1dc1-4942-9589-2dac00a0268e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:22.926620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9d9a1-1dc1-4942-9589-2dac00a0268e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:22.932340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:22.933213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:22.933684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:22.933972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] PATH_INFO: `/v3/projects/49b0c9b1afa94007b6d407f8339c2ac4` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:22.935352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b0c9b1afa94007b6d407f8339c2ac4)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:22.937688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:23.075083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b0c9b1afa94007b6d407f8339c2ac4', 'request_id': 'req-635c59d8-d301-4423-b439-4d9c2971f921'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:23.086454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b0c9b1afa94007b6d407f8339c2ac4', 'request_id': 'req-635c59d8-d301-4423-b439-4d9c2971f921'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:23.091437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:23.171790 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b0c9b1afa94007b6d407f8339c2ac4', 'request_id': 'req-635c59d8-d301-4423-b439-4d9c2971f921'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:23.187837 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] The token cache is being invalidate because project 49b0c9b1afa94007b6d407f8339c2ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:23.188235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:23.188926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:23.190740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 949/1888] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:22 2022] DELETE /identity/v3/projects/49b0c9b1afa94007b6d407f8339c2ac4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:23.194601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea75ab-18cd-4cf4-afc5-701e2266ab36 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:23.205111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea75ab-18cd-4cf4-afc5-701e2266ab36 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:23.271962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:23.272643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:23.272964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:23.273322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] PATH_INFO: `/v3/users/9b7de3df7b9e498b8d52bc7951ceca67` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:23.274459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7de3df7b9e498b8d52bc7951ceca67)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:23.276397 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:23.484842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:23.489795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7de3df7b9e498b8d52bc7951ceca67'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:23.497471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7de3df7b9e498b8d52bc7951ceca67'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:23.555112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7de3df7b9e498b8d52bc7951ceca67'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:23.555753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7de3df7b9e498b8d52bc7951ceca67'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:23.556414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bc5b8e99-3b27-49b9-aae4-2eaac585dd0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7de3df7b9e498b8d52bc7951ceca67'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:23.577520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 940/1889] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:23 2022] DELETE /identity/v3/users/9b7de3df7b9e498b8d52bc7951ceca67 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:24.111004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:24.113162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:24.128707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c59d8-d301-4423-b439-4d9c2971f921 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:24.251551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:24.252253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:24.252746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:24.253186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] PATH_INFO: `/v3/projects/3d3abe04a81a4fcaa53ab8e42fbf6108` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:24.254350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3abe04a81a4fcaa53ab8e42fbf6108)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:24.256549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:24.379454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3abe04a81a4fcaa53ab8e42fbf6108', 'request_id': 'req-d0f2f463-fe32-4b13-a774-04fd7d36c997'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:24.385742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3abe04a81a4fcaa53ab8e42fbf6108', 'request_id': 'req-d0f2f463-fe32-4b13-a774-04fd7d36c997'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:24.503331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3abe04a81a4fcaa53ab8e42fbf6108', 'request_id': 'req-d0f2f463-fe32-4b13-a774-04fd7d36c997'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:24.514301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] The token cache is being invalidate because project 3d3abe04a81a4fcaa53ab8e42fbf6108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:24.518042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:24.518042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d0f2f463-fe32-4b13-a774-04fd7d36c997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:24.518042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 950/1890] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:24 2022] DELETE /identity/v3/projects/3d3abe04a81a4fcaa53ab8e42fbf6108 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:24.523388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6cbf1-169c-4fea-b20e-cc4b6bee5e05 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:24.523870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6cbf1-169c-4fea-b20e-cc4b6bee5e05 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:24.523982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6cbf1-169c-4fea-b20e-cc4b6bee5e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:24.544701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dae6cbf1-169c-4fea-b20e-cc4b6bee5e05 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:24.545970 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dae6cbf1-169c-4fea-b20e-cc4b6bee5e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:24.614213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 941/1891] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:24.623720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568b87-ea55-473b-873d-e1338d39c52f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:24.624009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568b87-ea55-473b-873d-e1338d39c52f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:24.624340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568b87-ea55-473b-873d-e1338d39c52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:24.645240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ad568b87-ea55-473b-873d-e1338d39c52f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:24.646576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ad568b87-ea55-473b-873d-e1338d39c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:24.656561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 951/1892] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:24.660807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6cbf1-169c-4fea-b20e-cc4b6bee5e05 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:24.671403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6cbf1-169c-4fea-b20e-cc4b6bee5e05 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:24.676518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c870753-6c1f-4c40-a3fb-15f7591619f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:24.684380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c870753-6c1f-4c40-a3fb-15f7591619f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:24.684380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c870753-6c1f-4c40-a3fb-15f7591619f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:24.684380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c870753-6c1f-4c40-a3fb-15f7591619f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:24.684380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c870753-6c1f-4c40-a3fb-15f7591619f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:20:24.684380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c870753-6c1f-4c40-a3fb-15f7591619f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:24.684380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c870753-6c1f-4c40-a3fb-15f7591619f0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:24.696931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 942/1893] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:20:24.698106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568b87-ea55-473b-873d-e1338d39c52f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:24.708823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568b87-ea55-473b-873d-e1338d39c52f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:24.713686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e3884-5f70-443b-adea-3d511174404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:24.714353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3884-5f70-443b-adea-3d511174404b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:24.714638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3884-5f70-443b-adea-3d511174404b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:24.714909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3884-5f70-443b-adea-3d511174404b admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:24.715546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e3884-5f70-443b-adea-3d511174404b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:24.717461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e3884-5f70-443b-adea-3d511174404b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:24.838338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 952/1894] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:20:24 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:24.842599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c870753-6c1f-4c40-a3fb-15f7591619f0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:24.852824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c870753-6c1f-4c40-a3fb-15f7591619f0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:24.909522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485b41e-86c2-4899-bd06-c720cc73887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:24.910134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485b41e-86c2-4899-bd06-c720cc73887e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:24.910416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485b41e-86c2-4899-bd06-c720cc73887e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:24.910691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485b41e-86c2-4899-bd06-c720cc73887e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:24.911336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485b41e-86c2-4899-bd06-c720cc73887e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:24.913295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485b41e-86c2-4899-bd06-c720cc73887e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:24.994996 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 943/1895] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:20:24 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:24.999462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e3884-5f70-443b-adea-3d511174404b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:25.010695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e3884-5f70-443b-adea-3d511174404b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:25.015282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff40f-535b-4b31-a32b-e8348947e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:25.015887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff40f-535b-4b31-a32b-e8348947e835 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:25.016164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff40f-535b-4b31-a32b-e8348947e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:25.016474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff40f-535b-4b31-a32b-e8348947e835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:25.017163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ff40f-535b-4b31-a32b-e8348947e835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:25.018756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ff40f-535b-4b31-a32b-e8348947e835 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:25.029752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 953/1896] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:25.033787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485b41e-86c2-4899-bd06-c720cc73887e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:25.044238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485b41e-86c2-4899-bd06-c720cc73887e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:25.049640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c3d76-d65b-4bf5-8e2d-36b6c786258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:25.050237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c3d76-d65b-4bf5-8e2d-36b6c786258d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:25.050519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c3d76-d65b-4bf5-8e2d-36b6c786258d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:25.050792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c3d76-d65b-4bf5-8e2d-36b6c786258d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:25.051438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c3d76-d65b-4bf5-8e2d-36b6c786258d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:25.053048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c3d76-d65b-4bf5-8e2d-36b6c786258d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:25.064845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 944/1897] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:25.069422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff40f-535b-4b31-a32b-e8348947e835 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:25.079743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff40f-535b-4b31-a32b-e8348947e835 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:25.084422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a70d4-0e78-496f-9659-c230bd906c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:25.085072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a70d4-0e78-496f-9659-c230bd906c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:25.085353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a70d4-0e78-496f-9659-c230bd906c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:25.085685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a70d4-0e78-496f-9659-c230bd906c37 admin admin] PATH_INFO: `/v3/projects/9ce2d34f7ca24966b42e8d4756b8b7f0/users/807879a10dca49c8b719409296785ed2/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:25.100958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a70d4-0e78-496f-9659-c230bd906c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce2d34f7ca24966b42e8d4756b8b7f0, user_id=807879a10dca49c8b719409296785ed2, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:25.103664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a70d4-0e78-496f-9659-c230bd906c37 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:25.213006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 954/1898] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:25 2022] PUT /identity/v3/projects/9ce2d34f7ca24966b42e8d4756b8b7f0/users/807879a10dca49c8b719409296785ed2/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:25.224611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a79bc9-6833-4a9e-a140-b9268e8bbe2f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:25.225003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a79bc9-6833-4a9e-a140-b9268e8bbe2f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:25.225505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a79bc9-6833-4a9e-a140-b9268e8bbe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:25.268331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f3a79bc9-6833-4a9e-a140-b9268e8bbe2f None None] MFA Rules not processed for user `807879a10dca49c8b719409296785ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:25.271147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f3a79bc9-6833-4a9e-a140-b9268e8bbe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:25.289270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:25.356925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 945/1899] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:25.371509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a70d4-0e78-496f-9659-c230bd906c37 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:25.373593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0a4a70d4-0e78-496f-9659-c230bd906c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:25.388884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:25.447158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a70d4-0e78-496f-9659-c230bd906c37 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:25.448480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21db7-fe5e-45ba-ab38-64c91eb7bfba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:25.449369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21db7-fe5e-45ba-ab38-64c91eb7bfba service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:25.451866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21db7-fe5e-45ba-ab38-64c91eb7bfba service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:25.452416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21db7-fe5e-45ba-ab38-64c91eb7bfba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:25.465855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21db7-fe5e-45ba-ab38-64c91eb7bfba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:25.467513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21db7-fe5e-45ba-ab38-64c91eb7bfba service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:25.478444 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 955/1900] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:25.517288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a79bc9-6833-4a9e-a140-b9268e8bbe2f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:25.591282 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a79bc9-6833-4a9e-a140-b9268e8bbe2f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:25.596915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:25.597456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:25.597737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:25.598013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] PATH_INFO: `/v3/users/807879a10dca49c8b719409296785ed2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:25.599198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=807879a10dca49c8b719409296785ed2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:25.601154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:25.773800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807879a10dca49c8b719409296785ed2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:25.783167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807879a10dca49c8b719409296785ed2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:25.858943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807879a10dca49c8b719409296785ed2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:25.859611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807879a10dca49c8b719409296785ed2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:25.860378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807879a10dca49c8b719409296785ed2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:25.884245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 946/1901] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:25 2022] DELETE /identity/v3/users/807879a10dca49c8b719409296785ed2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:25.887134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c180a3-9265-4ca2-88bb-3ad04edd08d2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:25.887398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c180a3-9265-4ca2-88bb-3ad04edd08d2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:25.887661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c180a3-9265-4ca2-88bb-3ad04edd08d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:25.918919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f3c180a3-9265-4ca2-88bb-3ad04edd08d2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:25.920311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f3c180a3-9265-4ca2-88bb-3ad04edd08d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:25.982586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 956/1902] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:20:25.992692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:25.994740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:26.035594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:26.070033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6576d6-9b5b-4a34-8b12-9335081d6dd0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:26.081348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee075885-5945-455c-8d56-8a6ebf06a976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:26.082200 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee075885-5945-455c-8d56-8a6ebf06a976 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:26.082313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee075885-5945-455c-8d56-8a6ebf06a976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:26.082591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee075885-5945-455c-8d56-8a6ebf06a976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:26.093709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee075885-5945-455c-8d56-8a6ebf06a976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:26.094186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee075885-5945-455c-8d56-8a6ebf06a976 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:26.114199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 947/1903] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:26.959018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c180a3-9265-4ca2-88bb-3ad04edd08d2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:26.961078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f3c180a3-9265-4ca2-88bb-3ad04edd08d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:26.974460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c180a3-9265-4ca2-88bb-3ad04edd08d2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:26.981079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:26.981743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:26.982036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:26.982315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] PATH_INFO: `/v3/projects/9ce2d34f7ca24966b42e8d4756b8b7f0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:26.983683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce2d34f7ca24966b42e8d4756b8b7f0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:26.986164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:27.109208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce2d34f7ca24966b42e8d4756b8b7f0', 'request_id': 'req-95be27e0-c8b4-41b4-8810-f54e721fc3d0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:27.117527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce2d34f7ca24966b42e8d4756b8b7f0', 'request_id': 'req-95be27e0-c8b4-41b4-8810-f54e721fc3d0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:27.195348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce2d34f7ca24966b42e8d4756b8b7f0', 'request_id': 'req-95be27e0-c8b4-41b4-8810-f54e721fc3d0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:27.207411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] The token cache is being invalidate because project 9ce2d34f7ca24966b42e8d4756b8b7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:27.207794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:27.208613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-95be27e0-c8b4-41b4-8810-f54e721fc3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:27.210339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 957/1904] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:26 2022] DELETE /identity/v3/projects/9ce2d34f7ca24966b42e8d4756b8b7f0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:27.215326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9c59-8155-49cb-8bf8-134512e6501b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:27.215826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9c59-8155-49cb-8bf8-134512e6501b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:27.215901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9c59-8155-49cb-8bf8-134512e6501b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:27.238995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8bec9c59-8155-49cb-8bf8-134512e6501b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:27.240426 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8bec9c59-8155-49cb-8bf8-134512e6501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:27.314448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 948/1905] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:27.322334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5deac-40b8-44f4-8de3-daf8b8c98152 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:27.322672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5deac-40b8-44f4-8de3-daf8b8c98152 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:27.322989 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5deac-40b8-44f4-8de3-daf8b8c98152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:27.346155 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-98d5deac-40b8-44f4-8de3-daf8b8c98152 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:27.347283 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-98d5deac-40b8-44f4-8de3-daf8b8c98152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:27.357927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 958/1906] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:27.361817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9c59-8155-49cb-8bf8-134512e6501b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:27.377275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9c59-8155-49cb-8bf8-134512e6501b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:27.383043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bf1b1-e975-41c3-805d-6033b6ada7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:27.383879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bf1b1-e975-41c3-805d-6033b6ada7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:27.384336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bf1b1-e975-41c3-805d-6033b6ada7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:27.384678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bf1b1-e975-41c3-805d-6033b6ada7d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:27.385408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bf1b1-e975-41c3-805d-6033b6ada7d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:20:27.385786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bf1b1-e975-41c3-805d-6033b6ada7d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:27.387464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bf1b1-e975-41c3-805d-6033b6ada7d6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:27.404816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 949/1907] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:20:27.406720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5deac-40b8-44f4-8de3-daf8b8c98152 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:27.417390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5deac-40b8-44f4-8de3-daf8b8c98152 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:27.423078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213616f6-ee0c-47a3-9c00-94c53455faeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:27.423771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213616f6-ee0c-47a3-9c00-94c53455faeb admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:27.424044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213616f6-ee0c-47a3-9c00-94c53455faeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:27.424375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213616f6-ee0c-47a3-9c00-94c53455faeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:27.425057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213616f6-ee0c-47a3-9c00-94c53455faeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:27.427165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213616f6-ee0c-47a3-9c00-94c53455faeb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:27.571391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 959/1908] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:20:27 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:27.571623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bf1b1-e975-41c3-805d-6033b6ada7d6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:27.582591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bf1b1-e975-41c3-805d-6033b6ada7d6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:27.699726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dacf47-9c64-4993-b732-a537fe03c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:27.700400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dacf47-9c64-4993-b732-a537fe03c55e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:27.700675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dacf47-9c64-4993-b732-a537fe03c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:27.700954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dacf47-9c64-4993-b732-a537fe03c55e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:27.701639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dacf47-9c64-4993-b732-a537fe03c55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:27.705286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dacf47-9c64-4993-b732-a537fe03c55e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:27.874926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213616f6-ee0c-47a3-9c00-94c53455faeb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:27.883625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 950/1909] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:20:27 2022] POST /identity/v3/users => generated 284 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:20:27.891739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213616f6-ee0c-47a3-9c00-94c53455faeb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:27.900028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c718a7-1301-4755-9d6a-21fbf5b6d2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:27.900028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c718a7-1301-4755-9d6a-21fbf5b6d2db admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:27.900028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c718a7-1301-4755-9d6a-21fbf5b6d2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:27.900028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c718a7-1301-4755-9d6a-21fbf5b6d2db admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:27.900555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c718a7-1301-4755-9d6a-21fbf5b6d2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:27.901745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c718a7-1301-4755-9d6a-21fbf5b6d2db admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:27.904618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:27.927654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 960/1910] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:20:27.931734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dacf47-9c64-4993-b732-a537fe03c55e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:27.944410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dacf47-9c64-4993-b732-a537fe03c55e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:27.949512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0314e-9bdb-4907-ae92-44bfab6edbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:27.950231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0314e-9bdb-4907-ae92-44bfab6edbad admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:27.950588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0314e-9bdb-4907-ae92-44bfab6edbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:27.950939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0314e-9bdb-4907-ae92-44bfab6edbad admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:27.951673 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0314e-9bdb-4907-ae92-44bfab6edbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:27.953406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0314e-9bdb-4907-ae92-44bfab6edbad admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:27.971595 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 951/1911] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:27.975978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c718a7-1301-4755-9d6a-21fbf5b6d2db admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:27.988459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c718a7-1301-4755-9d6a-21fbf5b6d2db admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:28.002377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07defc94-aa97-446c-b16b-e9a715abe7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:28.003534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07defc94-aa97-446c-b16b-e9a715abe7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:28.004110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07defc94-aa97-446c-b16b-e9a715abe7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:28.004601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07defc94-aa97-446c-b16b-e9a715abe7b6 admin admin] PATH_INFO: `/v3/projects/9ef7984bfb9c4101b7050247eeb5d6ba/users/35bfeb94e4a44a76abcd991c64c54348/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:28.035579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07defc94-aa97-446c-b16b-e9a715abe7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef7984bfb9c4101b7050247eeb5d6ba, user_id=35bfeb94e4a44a76abcd991c64c54348, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:28.038492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07defc94-aa97-446c-b16b-e9a715abe7b6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:28.088645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 961/1912] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:27 2022] PUT /identity/v3/projects/9ef7984bfb9c4101b7050247eeb5d6ba/users/35bfeb94e4a44a76abcd991c64c54348/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:28.101448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247d96c-5926-4a4c-9f81-5de8a8a0e42e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:28.101632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247d96c-5926-4a4c-9f81-5de8a8a0e42e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:28.101907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247d96c-5926-4a4c-9f81-5de8a8a0e42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:28.166336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9247d96c-5926-4a4c-9f81-5de8a8a0e42e None None] MFA Rules not processed for user `35bfeb94e4a44a76abcd991c64c54348`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:28.167839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9247d96c-5926-4a4c-9f81-5de8a8a0e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:28.261556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:28.319979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 952/1913] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:28.334570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07defc94-aa97-446c-b16b-e9a715abe7b6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:28.343071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-07defc94-aa97-446c-b16b-e9a715abe7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:28.465409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07defc94-aa97-446c-b16b-e9a715abe7b6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:28.469475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad053-b8ca-4a61-96cb-381217ed885a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b84587baf0432c800a6278d7095cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:28.470213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad053-b8ca-4a61-96cb-381217ed885a service glance] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:28.470610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad053-b8ca-4a61-96cb-381217ed885a service glance] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:28.470953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad053-b8ca-4a61-96cb-381217ed885a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:28.480625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ad053-b8ca-4a61-96cb-381217ed885a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:28.483462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ad053-b8ca-4a61-96cb-381217ed885a service glance] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:28.494060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 962/1914] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:30.406173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832116-e8f5-41ef-9645-92a654944c29 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:30.406837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832116-e8f5-41ef-9645-92a654944c29 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:30.406837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832116-e8f5-41ef-9645-92a654944c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:30.433635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a7832116-e8f5-41ef-9645-92a654944c29 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:30.435161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a7832116-e8f5-41ef-9645-92a654944c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:30.496106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 953/1915] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:30.510769 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad053-b8ca-4a61-96cb-381217ed885a service glance] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:30.512320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0a8ad053-b8ca-4a61-96cb-381217ed885a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:30.597226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad053-b8ca-4a61-96cb-381217ed885a service glance] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:30.602612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac341b9-34b7-46de-a185-feb222d29376 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:30.603226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac341b9-34b7-46de-a185-feb222d29376 service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:30.603510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac341b9-34b7-46de-a185-feb222d29376 service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:30.603778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac341b9-34b7-46de-a185-feb222d29376 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:30.619558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac341b9-34b7-46de-a185-feb222d29376 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:30.621356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac341b9-34b7-46de-a185-feb222d29376 service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:30.631995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 963/1916] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:20:33.436183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7832116-e8f5-41ef-9645-92a654944c29 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:33.438513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a7832116-e8f5-41ef-9645-92a654944c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:33.513450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7832116-e8f5-41ef-9645-92a654944c29 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:33.519905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:33.520912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:33.520912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:33.521212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] PATH_INFO: `/v3/users/bd71bbac0499407aa1b6b9738da540fc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:33.522398 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd71bbac0499407aa1b6b9738da540fc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:33.524383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:33.765695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd71bbac0499407aa1b6b9738da540fc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:33.773952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd71bbac0499407aa1b6b9738da540fc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:33.851894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd71bbac0499407aa1b6b9738da540fc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:33.852550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd71bbac0499407aa1b6b9738da540fc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:33.853173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd71bbac0499407aa1b6b9738da540fc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:33.865919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:33.872768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 954/1917] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:33 2022] DELETE /identity/v3/users/bd71bbac0499407aa1b6b9738da540fc => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:33.878398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95465d48-0eb7-4f16-b5b0-1d2df3903131 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:33.878914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95465d48-0eb7-4f16-b5b0-1d2df3903131 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:33.879057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95465d48-0eb7-4f16-b5b0-1d2df3903131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:33.898378 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-95465d48-0eb7-4f16-b5b0-1d2df3903131 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:33.899566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-95465d48-0eb7-4f16-b5b0-1d2df3903131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:33.959939 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 964/1918] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:33.969805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:33.971842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:34.046491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba0d52-acfe-4bb0-b5cb-d0fe401b1f09 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:34.051961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da144fa-75e6-47dc-ab5e-f6afa0a7eac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:34.052750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da144fa-75e6-47dc-ab5e-f6afa0a7eac0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:34.053424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da144fa-75e6-47dc-ab5e-f6afa0a7eac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:34.053780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da144fa-75e6-47dc-ab5e-f6afa0a7eac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:34.067233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da144fa-75e6-47dc-ab5e-f6afa0a7eac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:34.068751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da144fa-75e6-47dc-ab5e-f6afa0a7eac0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:34.079435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 955/1919] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:34.617142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95465d48-0eb7-4f16-b5b0-1d2df3903131 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:34.618724 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-95465d48-0eb7-4f16-b5b0-1d2df3903131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:34.646774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95465d48-0eb7-4f16-b5b0-1d2df3903131 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:34.652985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:34.653771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:34.654819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:34.654819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] PATH_INFO: `/v3/projects/9abdd67f3643446cbd6fa9ffa33ecbdf` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:34.656501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9abdd67f3643446cbd6fa9ffa33ecbdf)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:34.659182 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:34.661213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:34.768843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9abdd67f3643446cbd6fa9ffa33ecbdf', 'request_id': 'req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:34.776611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9abdd67f3643446cbd6fa9ffa33ecbdf', 'request_id': 'req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:34.904194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9abdd67f3643446cbd6fa9ffa33ecbdf', 'request_id': 'req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:34.917309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] The token cache is being invalidate because project 9abdd67f3643446cbd6fa9ffa33ecbdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:34.917752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:34.918431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1521a510-b9e6-49fc-bf1f-ea8e12fd3b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:34.921612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 965/1920] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:34 2022] DELETE /identity/v3/projects/9abdd67f3643446cbd6fa9ffa33ecbdf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:44.074795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=28 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:44.995332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:45.079546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da144fa-75e6-47dc-ab5e-f6afa0a7eac0 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:45.081611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7da144fa-75e6-47dc-ab5e-f6afa0a7eac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:45.097297 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da144fa-75e6-47dc-ab5e-f6afa0a7eac0 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:45.168046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:45.169276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:45.176155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:45.176155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] PATH_INFO: `/v3/users/829230375d4e489bbb9c03904db4fa2d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:45.176155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829230375d4e489bbb9c03904db4fa2d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:45.176155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:45.341894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829230375d4e489bbb9c03904db4fa2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:45.349301 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829230375d4e489bbb9c03904db4fa2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:45.400712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829230375d4e489bbb9c03904db4fa2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:45.401345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829230375d4e489bbb9c03904db4fa2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:45.402100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829230375d4e489bbb9c03904db4fa2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:45.434659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 956/1921] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:45 2022] DELETE /identity/v3/users/829230375d4e489bbb9c03904db4fa2d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:45.439529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324874-7186-4158-a6f5-e8b3abf87f92 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:45.439819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324874-7186-4158-a6f5-e8b3abf87f92 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:45.440903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324874-7186-4158-a6f5-e8b3abf87f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:45.469429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6c324874-7186-4158-a6f5-e8b3abf87f92 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:45.470945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6c324874-7186-4158-a6f5-e8b3abf87f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:45.541167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 966/1922] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:45.552710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:45.554469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:45.652809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715e08-36b4-44c9-8b89-a09b4c5090f8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:45.656475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4ab25-9a64-4616-9749-deac1f942a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:45.657119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4ab25-9a64-4616-9749-deac1f942a91 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:45.657450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4ab25-9a64-4616-9749-deac1f942a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:45.657725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4ab25-9a64-4616-9749-deac1f942a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:45.668039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4ab25-9a64-4616-9749-deac1f942a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:45.669881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4ab25-9a64-4616-9749-deac1f942a91 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:45.683977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 957/1923] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:46.567790 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324874-7186-4158-a6f5-e8b3abf87f92 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:46.570032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6c324874-7186-4158-a6f5-e8b3abf87f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:46.584419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324874-7186-4158-a6f5-e8b3abf87f92 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:46.589752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:46.590380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:46.590664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:46.590942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] PATH_INFO: `/v3/projects/4b6c3d6094ee4678a4d0090ae9c3f75e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:46.592110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6c3d6094ee4678a4d0090ae9c3f75e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:46.594140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:46.736028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6c3d6094ee4678a4d0090ae9c3f75e', 'request_id': 'req-de05cf8e-0652-46b1-a089-ea95f46ea161'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:46.744274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6c3d6094ee4678a4d0090ae9c3f75e', 'request_id': 'req-de05cf8e-0652-46b1-a089-ea95f46ea161'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:46.801101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6c3d6094ee4678a4d0090ae9c3f75e', 'request_id': 'req-de05cf8e-0652-46b1-a089-ea95f46ea161'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:46.814090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] The token cache is being invalidate because project 4b6c3d6094ee4678a4d0090ae9c3f75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:46.814399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:46.815091 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-de05cf8e-0652-46b1-a089-ea95f46ea161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:46.816751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 967/1924] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:46 2022] DELETE /identity/v3/projects/4b6c3d6094ee4678a4d0090ae9c3f75e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:46.821816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08d9fb-53a3-4040-a8ba-1dac73d36f8b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:46.822437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08d9fb-53a3-4040-a8ba-1dac73d36f8b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:46.822757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08d9fb-53a3-4040-a8ba-1dac73d36f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:46.844879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cb08d9fb-53a3-4040-a8ba-1dac73d36f8b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:46.846109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cb08d9fb-53a3-4040-a8ba-1dac73d36f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:46.864259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:46.907059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 958/1925] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:46.915110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908cf1c-908e-45ca-825e-32e0fa8d700c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:46.915454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908cf1c-908e-45ca-825e-32e0fa8d700c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:46.919566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908cf1c-908e-45ca-825e-32e0fa8d700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:46.935927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b908cf1c-908e-45ca-825e-32e0fa8d700c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:46.937229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b908cf1c-908e-45ca-825e-32e0fa8d700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:46.945798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 968/1926] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:46.950260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08d9fb-53a3-4040-a8ba-1dac73d36f8b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:46.960069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08d9fb-53a3-4040-a8ba-1dac73d36f8b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:46.964896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddb21c-c436-4419-ba3d-a77f7ed9c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:46.965528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddb21c-c436-4419-ba3d-a77f7ed9c2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:46.965813 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddb21c-c436-4419-ba3d-a77f7ed9c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:46.966088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddb21c-c436-4419-ba3d-a77f7ed9c2c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:46.966858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddb21c-c436-4419-ba3d-a77f7ed9c2c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:20:46.967166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddb21c-c436-4419-ba3d-a77f7ed9c2c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:46.968796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddb21c-c436-4419-ba3d-a77f7ed9c2c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:46.988621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 959/1927] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:20:46.988838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908cf1c-908e-45ca-825e-32e0fa8d700c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:47.001742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908cf1c-908e-45ca-825e-32e0fa8d700c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:47.006951 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3a180-b3e7-4e25-9ee8-8e7413fdfa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:47.007584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3a180-b3e7-4e25-9ee8-8e7413fdfa4b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:47.007866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3a180-b3e7-4e25-9ee8-8e7413fdfa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:47.008143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3a180-b3e7-4e25-9ee8-8e7413fdfa4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:47.008828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3a180-b3e7-4e25-9ee8-8e7413fdfa4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:47.017691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3a180-b3e7-4e25-9ee8-8e7413fdfa4b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:47.111944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 969/1928] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:20:46 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:47.117518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddb21c-c436-4419-ba3d-a77f7ed9c2c5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:47.131199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddb21c-c436-4419-ba3d-a77f7ed9c2c5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:47.205196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af094cb6-5250-4d16-8952-7ff00578cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:47.205813 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af094cb6-5250-4d16-8952-7ff00578cb3e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:47.206268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af094cb6-5250-4d16-8952-7ff00578cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:47.206474 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af094cb6-5250-4d16-8952-7ff00578cb3e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:47.207071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af094cb6-5250-4d16-8952-7ff00578cb3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:47.209178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af094cb6-5250-4d16-8952-7ff00578cb3e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:47.299620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 960/1929] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:20:47 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:47.304746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3a180-b3e7-4e25-9ee8-8e7413fdfa4b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:47.325443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3a180-b3e7-4e25-9ee8-8e7413fdfa4b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:47.331649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5665f-c7c9-4d02-a72e-8ffbb0e2af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:47.331649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5665f-c7c9-4d02-a72e-8ffbb0e2af4c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:47.331996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5665f-c7c9-4d02-a72e-8ffbb0e2af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:47.332145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5665f-c7c9-4d02-a72e-8ffbb0e2af4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:47.333126 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5665f-c7c9-4d02-a72e-8ffbb0e2af4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:47.334875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5665f-c7c9-4d02-a72e-8ffbb0e2af4c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:47.350381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 970/1930] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:47.352661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af094cb6-5250-4d16-8952-7ff00578cb3e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:47.364637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af094cb6-5250-4d16-8952-7ff00578cb3e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:47.370665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6ffc7-10ef-4678-abc1-e578ff8d6ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:47.371533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6ffc7-10ef-4678-abc1-e578ff8d6ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:47.372028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6ffc7-10ef-4678-abc1-e578ff8d6ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:47.372983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6ffc7-10ef-4678-abc1-e578ff8d6ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:47.373833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6ffc7-10ef-4678-abc1-e578ff8d6ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:47.375797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6ffc7-10ef-4678-abc1-e578ff8d6ce6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:47.389908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 961/1931] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:47.394819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5665f-c7c9-4d02-a72e-8ffbb0e2af4c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:47.404705 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5665f-c7c9-4d02-a72e-8ffbb0e2af4c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:47.410410 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7358fdc-221c-4f6b-8acc-242f0e18ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:47.411090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7358fdc-221c-4f6b-8acc-242f0e18ef1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:47.411367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7358fdc-221c-4f6b-8acc-242f0e18ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:47.411646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7358fdc-221c-4f6b-8acc-242f0e18ef1b admin admin] PATH_INFO: `/v3/projects/a99304e5c36643bea7d9e6511f12a49d/users/ae2baba72a0b4b87b014a7edd8359ce7/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:47.436876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7358fdc-221c-4f6b-8acc-242f0e18ef1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99304e5c36643bea7d9e6511f12a49d, user_id=ae2baba72a0b4b87b014a7edd8359ce7, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:47.444016 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7358fdc-221c-4f6b-8acc-242f0e18ef1b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:47.528427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 971/1932] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:47 2022] PUT /identity/v3/projects/a99304e5c36643bea7d9e6511f12a49d/users/ae2baba72a0b4b87b014a7edd8359ce7/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:47.547995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad483f6-3363-40cf-ae51-56dfa26fe37c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:47.551187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad483f6-3363-40cf-ae51-56dfa26fe37c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:47.551187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad483f6-3363-40cf-ae51-56dfa26fe37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:47.600935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7ad483f6-3363-40cf-ae51-56dfa26fe37c None None] MFA Rules not processed for user `ae2baba72a0b4b87b014a7edd8359ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:47.617898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7ad483f6-3363-40cf-ae51-56dfa26fe37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:47.721048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 962/1933] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:47.732893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7358fdc-221c-4f6b-8acc-242f0e18ef1b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:47.734866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d7358fdc-221c-4f6b-8acc-242f0e18ef1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:47.760004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:47.807282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7358fdc-221c-4f6b-8acc-242f0e18ef1b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:47.811308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511d7f-9253-4c76-8386-c6b910cacf24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:47.812028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511d7f-9253-4c76-8386-c6b910cacf24 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:47.812419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511d7f-9253-4c76-8386-c6b910cacf24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:47.812763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511d7f-9253-4c76-8386-c6b910cacf24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:47.822540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7511d7f-9253-4c76-8386-c6b910cacf24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:47.824121 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7511d7f-9253-4c76-8386-c6b910cacf24 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:47.834640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 972/1934] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:48.448760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1360a-5276-4a04-ba40-620fb1ee9230 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:48.460464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1360a-5276-4a04-ba40-620fb1ee9230 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:48.460464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1360a-5276-4a04-ba40-620fb1ee9230 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:48.460464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 963/1935] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 12:20:48.467241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f493e8-f905-429e-a31c-8e9a3aa82625 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:48.467752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f493e8-f905-429e-a31c-8e9a3aa82625 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:48.468182 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f493e8-f905-429e-a31c-8e9a3aa82625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:48.491740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f9f493e8-f905-429e-a31c-8e9a3aa82625 None None] MFA Rules not processed for user `81919eaf832b4025a2118feb4e7fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:48.493069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f9f493e8-f905-429e-a31c-8e9a3aa82625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:48.567906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 973/1936] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:20:48.582044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0966d-9bf7-4545-86cd-e8f8c0657651 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:48.582330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0966d-9bf7-4545-86cd-e8f8c0657651 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:48.582608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0966d-9bf7-4545-86cd-e8f8c0657651 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:48.584421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 964/1937] 10.222.0.18 () {54 vars in 961 bytes} [Thu Sep 1 12:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:20:48.591836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f5d8-2d91-410e-ab7f-f2bf2a8219b5 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:48.592116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f5d8-2d91-410e-ab7f-f2bf2a8219b5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:48.592432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f5d8-2d91-410e-ab7f-f2bf2a8219b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:48.619796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1496f5d8-2d91-410e-ab7f-f2bf2a8219b5 None None] MFA Rules not processed for user `81919eaf832b4025a2118feb4e7fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:48.621563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1496f5d8-2d91-410e-ab7f-f2bf2a8219b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:48.621792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0966d-9bf7-4545-86cd-e8f8c0657651 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:48.624059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ca0966d-9bf7-4545-86cd-e8f8c0657651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:48.635552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 974/1938] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Sep 1 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:20:48.647347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496f5d8-2d91-410e-ab7f-f2bf2a8219b5 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:48.647876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:48.660302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496f5d8-2d91-410e-ab7f-f2bf2a8219b5 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:48.666411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6ded1-d980-4951-b6d2-b9151ebc22e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:48.667030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ded1-d980-4951-b6d2-b9151ebc22e2 service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:48.667314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ded1-d980-4951-b6d2-b9151ebc22e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:48.667590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6ded1-d980-4951-b6d2-b9151ebc22e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:48.679912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6ded1-d980-4951-b6d2-b9151ebc22e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:48.679912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6ded1-d980-4951-b6d2-b9151ebc22e2 service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:48.690673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 975/1939] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:48.714489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0966d-9bf7-4545-86cd-e8f8c0657651 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:48.719134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:48.719857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:48.720140 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:48.720449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] PATH_INFO: `/v3/users/cf491a01dea94a2f93a40324c94d2612` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:48.722160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf491a01dea94a2f93a40324c94d2612)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:48.724067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:48.905567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf491a01dea94a2f93a40324c94d2612'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:48.912875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf491a01dea94a2f93a40324c94d2612'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:48.989365 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf491a01dea94a2f93a40324c94d2612'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:48.990005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf491a01dea94a2f93a40324c94d2612'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:48.990639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4118524b-336a-4e24-8612-317499c10c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf491a01dea94a2f93a40324c94d2612'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:49.009559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 965/1940] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:48 2022] DELETE /identity/v3/users/cf491a01dea94a2f93a40324c94d2612 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:49.385848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6ded1-d980-4951-b6d2-b9151ebc22e2 service placement] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:49.402532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6ded1-d980-4951-b6d2-b9151ebc22e2 service placement] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:49.490795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:49.491524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:49.491802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:49.492080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] PATH_INFO: `/v3/projects/708ba0405e024f0c9b8ed2c5f1775c9b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:49.493288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] RBAC: Authorizing `identity:delete_project(project_id=708ba0405e024f0c9b8ed2c5f1775c9b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:49.495218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:49.601610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:49.607680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708ba0405e024f0c9b8ed2c5f1775c9b', 'request_id': 'req-d7774137-3423-49ea-b9cf-8c4a3440918a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:49.614346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708ba0405e024f0c9b8ed2c5f1775c9b', 'request_id': 'req-d7774137-3423-49ea-b9cf-8c4a3440918a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:49.704088 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708ba0405e024f0c9b8ed2c5f1775c9b', 'request_id': 'req-d7774137-3423-49ea-b9cf-8c4a3440918a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:49.717154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] The token cache is being invalidate because project 708ba0405e024f0c9b8ed2c5f1775c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:49.717450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:49.718115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d7774137-3423-49ea-b9cf-8c4a3440918a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:49.719812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 976/1941] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:49 2022] DELETE /identity/v3/projects/708ba0405e024f0c9b8ed2c5f1775c9b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:49.725620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751eb51-ce2d-47a9-b36d-fc576b6a7938 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:49.726092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751eb51-ce2d-47a9-b36d-fc576b6a7938 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:49.726209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751eb51-ce2d-47a9-b36d-fc576b6a7938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:49.751744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9751eb51-ce2d-47a9-b36d-fc576b6a7938 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:49.753036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9751eb51-ce2d-47a9-b36d-fc576b6a7938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:49.812749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 966/1942] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:49.820596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7bdd-97b1-4733-9613-695f7ff980bb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:49.820885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7bdd-97b1-4733-9613-695f7ff980bb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:49.821167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7bdd-97b1-4733-9613-695f7ff980bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:49.841521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-966c7bdd-97b1-4733-9613-695f7ff980bb None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:49.842735 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-966c7bdd-97b1-4733-9613-695f7ff980bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:49.851646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 977/1943] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:49.856825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751eb51-ce2d-47a9-b36d-fc576b6a7938 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:49.866377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751eb51-ce2d-47a9-b36d-fc576b6a7938 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:49.871176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84afa82-47c8-4b3a-9233-554c16ee0595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:49.874076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84afa82-47c8-4b3a-9233-554c16ee0595 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:49.874076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84afa82-47c8-4b3a-9233-554c16ee0595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:49.874076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84afa82-47c8-4b3a-9233-554c16ee0595 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:49.874076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84afa82-47c8-4b3a-9233-554c16ee0595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:20:49.874076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84afa82-47c8-4b3a-9233-554c16ee0595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:49.875234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84afa82-47c8-4b3a-9233-554c16ee0595 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:49.888012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 967/1944] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:20:49.892446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c7bdd-97b1-4733-9613-695f7ff980bb None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:49.902489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c7bdd-97b1-4733-9613-695f7ff980bb None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:49.907205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53d5c-2fcd-46f1-8c92-3391e12e8cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:49.907834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53d5c-2fcd-46f1-8c92-3391e12e8cee admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:49.908114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53d5c-2fcd-46f1-8c92-3391e12e8cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:49.908414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53d5c-2fcd-46f1-8c92-3391e12e8cee admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:49.909693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb53d5c-2fcd-46f1-8c92-3391e12e8cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:49.911588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb53d5c-2fcd-46f1-8c92-3391e12e8cee admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:50.014775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 978/1945] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:20:49 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:20:50.019607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84afa82-47c8-4b3a-9233-554c16ee0595 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:50.029528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84afa82-47c8-4b3a-9233-554c16ee0595 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:50.054068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:50.097603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23eaed-d87c-4b3f-88c5-7477b3f3ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:50.098219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23eaed-d87c-4b3f-88c5-7477b3f3ca22 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:50.098506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23eaed-d87c-4b3f-88c5-7477b3f3ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:50.098785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23eaed-d87c-4b3f-88c5-7477b3f3ca22 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:50.099428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23eaed-d87c-4b3f-88c5-7477b3f3ca22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:50.101410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23eaed-d87c-4b3f-88c5-7477b3f3ca22 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:50.184223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 968/1946] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:20:50 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:20:50.188367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53d5c-2fcd-46f1-8c92-3391e12e8cee admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:50.199363 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53d5c-2fcd-46f1-8c92-3391e12e8cee admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:50.205552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4110-6326-42d5-a1ca-4c3580857335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:50.206826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4110-6326-42d5-a1ca-4c3580857335 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:50.207106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4110-6326-42d5-a1ca-4c3580857335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:50.207374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4110-6326-42d5-a1ca-4c3580857335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:50.208026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d4110-6326-42d5-a1ca-4c3580857335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:50.209755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d4110-6326-42d5-a1ca-4c3580857335 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:50.224129 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 979/1947] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:50.225709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23eaed-d87c-4b3f-88c5-7477b3f3ca22 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:50.236761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23eaed-d87c-4b3f-88c5-7477b3f3ca22 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:50.242309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c42b4-4dee-4167-b498-29474c7e29c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:50.242920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c42b4-4dee-4167-b498-29474c7e29c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:50.248360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c42b4-4dee-4167-b498-29474c7e29c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:50.248360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c42b4-4dee-4167-b498-29474c7e29c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:50.248360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c42b4-4dee-4167-b498-29474c7e29c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:50.248360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c42b4-4dee-4167-b498-29474c7e29c6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:50.257083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 969/1948] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:50.261252 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4110-6326-42d5-a1ca-4c3580857335 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:50.272196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4110-6326-42d5-a1ca-4c3580857335 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:50.277224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a0074-0b51-4b7e-9413-f066b47d34d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:50.277920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0074-0b51-4b7e-9413-f066b47d34d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:50.278198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0074-0b51-4b7e-9413-f066b47d34d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:50.278470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0074-0b51-4b7e-9413-f066b47d34d2 admin admin] PATH_INFO: `/v3/projects/54a0aac21aa3458d9e46c1c1654682e7/users/85b93333fe3e46ee80bf89e30ca40068/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:50.297799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a0074-0b51-4b7e-9413-f066b47d34d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a0aac21aa3458d9e46c1c1654682e7, user_id=85b93333fe3e46ee80bf89e30ca40068, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:50.300524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a0074-0b51-4b7e-9413-f066b47d34d2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:50.355608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 980/1949] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:50 2022] PUT /identity/v3/projects/54a0aac21aa3458d9e46c1c1654682e7/users/85b93333fe3e46ee80bf89e30ca40068/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:50.367242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03835-a1f1-4fd9-bd42-da384713eb7b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:50.367607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03835-a1f1-4fd9-bd42-da384713eb7b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:50.367891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03835-a1f1-4fd9-bd42-da384713eb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:50.399526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-62d03835-a1f1-4fd9-bd42-da384713eb7b None None] MFA Rules not processed for user `85b93333fe3e46ee80bf89e30ca40068`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:50.409049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-62d03835-a1f1-4fd9-bd42-da384713eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:50.473540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 970/1950] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:50.484463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a0074-0b51-4b7e-9413-f066b47d34d2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:50.486240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ed4a0074-0b51-4b7e-9413-f066b47d34d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:50.548713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a0074-0b51-4b7e-9413-f066b47d34d2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:50.553474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86782c53-375a-45ad-946c-b28bcaa50553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:50.554129 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86782c53-375a-45ad-946c-b28bcaa50553 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:50.554573 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86782c53-375a-45ad-946c-b28bcaa50553 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:50.554854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86782c53-375a-45ad-946c-b28bcaa50553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:50.563865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86782c53-375a-45ad-946c-b28bcaa50553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:50.565915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86782c53-375a-45ad-946c-b28bcaa50553 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:50.575076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 981/1951] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:55.550159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d03835-a1f1-4fd9-bd42-da384713eb7b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:55.551631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-62d03835-a1f1-4fd9-bd42-da384713eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:55.617486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d03835-a1f1-4fd9-bd42-da384713eb7b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:55.621932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:55.622805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:55.623085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:55.623356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] PATH_INFO: `/v3/users/ae2baba72a0b4b87b014a7edd8359ce7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:55.624506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2baba72a0b4b87b014a7edd8359ce7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:55.626413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:55.782957 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:55.791875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2baba72a0b4b87b014a7edd8359ce7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:55.798603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2baba72a0b4b87b014a7edd8359ce7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:55.858209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2baba72a0b4b87b014a7edd8359ce7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:55.858866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2baba72a0b4b87b014a7edd8359ce7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:55.859494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2baba72a0b4b87b014a7edd8359ce7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:55.880740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 971/1952] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:20:55 2022] DELETE /identity/v3/users/ae2baba72a0b4b87b014a7edd8359ce7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:55.885361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fcd15-50b9-44f5-aae4-d2425b812f96 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:55.885818 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fcd15-50b9-44f5-aae4-d2425b812f96 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:55.885936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fcd15-50b9-44f5-aae4-d2425b812f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:55.905271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-af2fcd15-50b9-44f5-aae4-d2425b812f96 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:55.906469 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-af2fcd15-50b9-44f5-aae4-d2425b812f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:55.964229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 982/1953] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:55.974339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:55.975741 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:56.036495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc301b-a337-4759-9b1e-a5763b2623da admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:56.040147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d04aa-b9d4-44e0-a9ab-16281747811c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:56.040725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d04aa-b9d4-44e0-a9ab-16281747811c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:56.041001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d04aa-b9d4-44e0-a9ab-16281747811c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:56.041278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d04aa-b9d4-44e0-a9ab-16281747811c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:56.051555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d04aa-b9d4-44e0-a9ab-16281747811c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:56.053041 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d04aa-b9d4-44e0-a9ab-16281747811c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:56.062695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 972/1954] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:20:56.614650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fcd15-50b9-44f5-aae4-d2425b812f96 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:56.616089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-af2fcd15-50b9-44f5-aae4-d2425b812f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:56.629775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fcd15-50b9-44f5-aae4-d2425b812f96 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:56.634969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:56.638308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:56.638308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:56.638308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] PATH_INFO: `/v3/projects/a99304e5c36643bea7d9e6511f12a49d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:56.638308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99304e5c36643bea7d9e6511f12a49d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:56.640365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:56.647945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:56.759739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99304e5c36643bea7d9e6511f12a49d', 'request_id': 'req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:56.766298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99304e5c36643bea7d9e6511f12a49d', 'request_id': 'req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:56.831512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99304e5c36643bea7d9e6511f12a49d', 'request_id': 'req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:56.843773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] The token cache is being invalidate because project a99304e5c36643bea7d9e6511f12a49d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:20:56.844065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:56.844738 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2cd4c477-8cc4-4594-b2c9-8f20d4845ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:20:56.846340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 983/1955] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:20:56 2022] DELETE /identity/v3/projects/a99304e5c36643bea7d9e6511f12a49d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:56.851423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510723-8fd3-4a19-b144-9aaa36ca4907 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:56.851899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510723-8fd3-4a19-b144-9aaa36ca4907 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:56.852016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510723-8fd3-4a19-b144-9aaa36ca4907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:56.871887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-75510723-8fd3-4a19-b144-9aaa36ca4907 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:56.873365 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-75510723-8fd3-4a19-b144-9aaa36ca4907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:56.934955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 973/1956] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:56.943238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c873-5b1b-4a3b-8a1f-7a7952f52d6a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:56.943701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c873-5b1b-4a3b-8a1f-7a7952f52d6a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:56.943809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c873-5b1b-4a3b-8a1f-7a7952f52d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:56.964670 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1765c873-5b1b-4a3b-8a1f-7a7952f52d6a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:56.965933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1765c873-5b1b-4a3b-8a1f-7a7952f52d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:56.973961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 984/1957] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:56.978213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75510723-8fd3-4a19-b144-9aaa36ca4907 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:56.988172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75510723-8fd3-4a19-b144-9aaa36ca4907 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:56.992962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e637141-ccbe-491b-9718-30234192913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:56.993585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e637141-ccbe-491b-9718-30234192913c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:56.993871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e637141-ccbe-491b-9718-30234192913c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:56.994145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e637141-ccbe-491b-9718-30234192913c admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:56.994792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e637141-ccbe-491b-9718-30234192913c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:20:56.995098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e637141-ccbe-491b-9718-30234192913c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:56.996720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e637141-ccbe-491b-9718-30234192913c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:57.009159 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 974/1958] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:20:57.013412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c873-5b1b-4a3b-8a1f-7a7952f52d6a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:57.023289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c873-5b1b-4a3b-8a1f-7a7952f52d6a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:57.027871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507acd2-1b0c-4075-a392-4317c15dc5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:57.028498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507acd2-1b0c-4075-a392-4317c15dc5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:57.028775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507acd2-1b0c-4075-a392-4317c15dc5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:57.029044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507acd2-1b0c-4075-a392-4317c15dc5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:57.029678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507acd2-1b0c-4075-a392-4317c15dc5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:57.031559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507acd2-1b0c-4075-a392-4317c15dc5d7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:57.117229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 985/1959] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:20:57 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:57.121296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e637141-ccbe-491b-9718-30234192913c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:57.132412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e637141-ccbe-491b-9718-30234192913c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:57.170817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:57.187035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b236ff8-5e6b-4466-967e-50e92fa9a5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:57.187660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b236ff8-5e6b-4466-967e-50e92fa9a5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:57.187927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b236ff8-5e6b-4466-967e-50e92fa9a5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:57.188281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b236ff8-5e6b-4466-967e-50e92fa9a5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:57.188928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b236ff8-5e6b-4466-967e-50e92fa9a5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:57.191452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b236ff8-5e6b-4466-967e-50e92fa9a5e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:57.298635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 975/1960] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:20:57 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:57.303803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507acd2-1b0c-4075-a392-4317c15dc5d7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:57.314476 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507acd2-1b0c-4075-a392-4317c15dc5d7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:57.319943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782ff08-8e3f-490c-a6b9-9bd2db699368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:57.320572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782ff08-8e3f-490c-a6b9-9bd2db699368 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:57.320858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782ff08-8e3f-490c-a6b9-9bd2db699368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:57.321136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782ff08-8e3f-490c-a6b9-9bd2db699368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:57.321782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782ff08-8e3f-490c-a6b9-9bd2db699368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:57.323376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782ff08-8e3f-490c-a6b9-9bd2db699368 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:57.333610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 986/1961] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:57.338417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b236ff8-5e6b-4466-967e-50e92fa9a5e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:57.348281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b236ff8-5e6b-4466-967e-50e92fa9a5e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:57.352796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893684c9-981b-481f-a823-c7b02663a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:57.353389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893684c9-981b-481f-a823-c7b02663a596 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:57.353670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893684c9-981b-481f-a823-c7b02663a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:57.354171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893684c9-981b-481f-a823-c7b02663a596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:57.354980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893684c9-981b-481f-a823-c7b02663a596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:57.356918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893684c9-981b-481f-a823-c7b02663a596 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:57.369048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 976/1962] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:57.373387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782ff08-8e3f-490c-a6b9-9bd2db699368 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:57.384066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782ff08-8e3f-490c-a6b9-9bd2db699368 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:57.388746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fac3d-9547-4814-ae0d-f54a2fcbaadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:57.389408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fac3d-9547-4814-ae0d-f54a2fcbaadd admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:57.389690 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fac3d-9547-4814-ae0d-f54a2fcbaadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:57.389969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fac3d-9547-4814-ae0d-f54a2fcbaadd admin admin] PATH_INFO: `/v3/projects/b9ff643e4104444a9072e840353dd816/users/1abc9d739c254ccb8b70ee24d09273d3/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:57.407703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fac3d-9547-4814-ae0d-f54a2fcbaadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ff643e4104444a9072e840353dd816, user_id=1abc9d739c254ccb8b70ee24d09273d3, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:57.410550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fac3d-9547-4814-ae0d-f54a2fcbaadd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:57.487610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 987/1963] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:57 2022] PUT /identity/v3/projects/b9ff643e4104444a9072e840353dd816/users/1abc9d739c254ccb8b70ee24d09273d3/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:20:57.498137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746254f-9ac1-4ef0-b3d9-2d3229c42f9d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:57.498445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746254f-9ac1-4ef0-b3d9-2d3229c42f9d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:57.498717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746254f-9ac1-4ef0-b3d9-2d3229c42f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:57.526585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3746254f-9ac1-4ef0-b3d9-2d3229c42f9d None None] MFA Rules not processed for user `1abc9d739c254ccb8b70ee24d09273d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:57.527787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3746254f-9ac1-4ef0-b3d9-2d3229c42f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:57.593838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 977/1964] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:57.599012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fac3d-9547-4814-ae0d-f54a2fcbaadd admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:57.691646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fac3d-9547-4814-ae0d-f54a2fcbaadd admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:57.696553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4a0c-d479-40c3-b3bb-5586325f72c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:57.697228 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4a0c-d479-40c3-b3bb-5586325f72c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:57.697519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4a0c-d479-40c3-b3bb-5586325f72c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:57.697822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4a0c-d479-40c3-b3bb-5586325f72c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:57.698437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c4a0c-d479-40c3-b3bb-5586325f72c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:57.700395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c4a0c-d479-40c3-b3bb-5586325f72c9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:57.815772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 988/1965] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:20:57 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:20:57.819737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746254f-9ac1-4ef0-b3d9-2d3229c42f9d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:57.831842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746254f-9ac1-4ef0-b3d9-2d3229c42f9d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:57.896431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1006597-91d0-4626-82b3-974e9d5bb8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:57.897201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1006597-91d0-4626-82b3-974e9d5bb8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:57.897293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1006597-91d0-4626-82b3-974e9d5bb8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:57.897566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1006597-91d0-4626-82b3-974e9d5bb8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:57.898249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1006597-91d0-4626-82b3-974e9d5bb8f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:57.900100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1006597-91d0-4626-82b3-974e9d5bb8f1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:58.030219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 978/1966] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:20:57 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:58.034943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4a0c-d479-40c3-b3bb-5586325f72c9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:58.045272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4a0c-d479-40c3-b3bb-5586325f72c9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:58.050012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186b8fc-6c50-42a9-83f5-4eeefebb6b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:58.052413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186b8fc-6c50-42a9-83f5-4eeefebb6b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:58.052413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186b8fc-6c50-42a9-83f5-4eeefebb6b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:58.052413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186b8fc-6c50-42a9-83f5-4eeefebb6b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:58.052413 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186b8fc-6c50-42a9-83f5-4eeefebb6b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:58.053459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186b8fc-6c50-42a9-83f5-4eeefebb6b83 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:58.064244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 989/1967] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:58.068426 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1006597-91d0-4626-82b3-974e9d5bb8f1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:58.078699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1006597-91d0-4626-82b3-974e9d5bb8f1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:58.083912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c75683-924a-4558-a77a-c37383cc75b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:58.084549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c75683-924a-4558-a77a-c37383cc75b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:58.084830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c75683-924a-4558-a77a-c37383cc75b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:58.085108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c75683-924a-4558-a77a-c37383cc75b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:58.085757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c75683-924a-4558-a77a-c37383cc75b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:58.087344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c75683-924a-4558-a77a-c37383cc75b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:58.098109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 979/1968] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:20:58.102801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186b8fc-6c50-42a9-83f5-4eeefebb6b83 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:58.108297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:58.116590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186b8fc-6c50-42a9-83f5-4eeefebb6b83 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:58.121461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa1b7-e1dd-4d39-ad89-eb45173ffe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:58.122122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa1b7-e1dd-4d39-ad89-eb45173ffe93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:58.122652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa1b7-e1dd-4d39-ad89-eb45173ffe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:58.122932 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa1b7-e1dd-4d39-ad89-eb45173ffe93 admin admin] PATH_INFO: `/v3/projects/1f33f9a22b664f5ba6470255b9919c32/users/a9446ef790e54aecaa6983d76751ef8d/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:58.137839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa1b7-e1dd-4d39-ad89-eb45173ffe93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f33f9a22b664f5ba6470255b9919c32, user_id=a9446ef790e54aecaa6983d76751ef8d, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:58.140553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa1b7-e1dd-4d39-ad89-eb45173ffe93 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:58.288236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 990/1969] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:58 2022] PUT /identity/v3/projects/1f33f9a22b664f5ba6470255b9919c32/users/a9446ef790e54aecaa6983d76751ef8d/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:58.299942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e6eac-2419-450a-8085-d63055c9788f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:58.300258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e6eac-2419-450a-8085-d63055c9788f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:58.300566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e6eac-2419-450a-8085-d63055c9788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:58.328315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-141e6eac-2419-450a-8085-d63055c9788f None None] MFA Rules not processed for user `a9446ef790e54aecaa6983d76751ef8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:58.329526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-141e6eac-2419-450a-8085-d63055c9788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:58.346668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:58.392444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 980/1970] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:58.397866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa1b7-e1dd-4d39-ad89-eb45173ffe93 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:58.460297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa1b7-e1dd-4d39-ad89-eb45173ffe93 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:58.465072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e0aaf-a127-4336-af6b-d9bc50160aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:58.469602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e0aaf-a127-4336-af6b-d9bc50160aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:58.469602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e0aaf-a127-4336-af6b-d9bc50160aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:58.469602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e0aaf-a127-4336-af6b-d9bc50160aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:58.469602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e0aaf-a127-4336-af6b-d9bc50160aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:58.469602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e0aaf-a127-4336-af6b-d9bc50160aa6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:58.594630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 991/1971] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:20:58 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:20:58.596078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e6eac-2419-450a-8085-d63055c9788f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:58.606927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e6eac-2419-450a-8085-d63055c9788f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:58.662623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a9d4-12e8-4f6e-bcbb-5ab9ca385e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:58.663233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a9d4-12e8-4f6e-bcbb-5ab9ca385e68 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:58.663517 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a9d4-12e8-4f6e-bcbb-5ab9ca385e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:58.663790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a9d4-12e8-4f6e-bcbb-5ab9ca385e68 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:58.665075 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a9d4-12e8-4f6e-bcbb-5ab9ca385e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:58.666979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a9d4-12e8-4f6e-bcbb-5ab9ca385e68 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:58.779394 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 981/1972] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:20:58 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:20:58.785464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e0aaf-a127-4336-af6b-d9bc50160aa6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:58.797056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e0aaf-a127-4336-af6b-d9bc50160aa6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:58.802856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7230-2c9a-4775-8a65-5ebf6f251caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:58.803480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7230-2c9a-4775-8a65-5ebf6f251caf admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:58.803761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7230-2c9a-4775-8a65-5ebf6f251caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:58.804037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7230-2c9a-4775-8a65-5ebf6f251caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:58.804729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d7230-2c9a-4775-8a65-5ebf6f251caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:58.806387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d7230-2c9a-4775-8a65-5ebf6f251caf admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:58.818757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 992/1973] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:58.823018 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a9d4-12e8-4f6e-bcbb-5ab9ca385e68 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:58.834067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a9d4-12e8-4f6e-bcbb-5ab9ca385e68 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:58.839060 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2cde9-425a-404d-bace-ee5bcd458d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:58.839787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2cde9-425a-404d-bace-ee5bcd458d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:58.840326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2cde9-425a-404d-bace-ee5bcd458d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:58.840681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2cde9-425a-404d-bace-ee5bcd458d58 admin admin] PATH_INFO: `/v3/projects/0f99d52cf5a84da4bccd74487d3ee95c/users/e0d637c75fe74899975d7d19dec9db38/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:58.857180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2cde9-425a-404d-bace-ee5bcd458d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f99d52cf5a84da4bccd74487d3ee95c, user_id=e0d637c75fe74899975d7d19dec9db38, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:58.859937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2cde9-425a-404d-bace-ee5bcd458d58 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:58.918154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 982/1974] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:58 2022] PUT /identity/v3/projects/0f99d52cf5a84da4bccd74487d3ee95c/users/e0d637c75fe74899975d7d19dec9db38/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:58.920829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7230-2c9a-4775-8a65-5ebf6f251caf admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:58.931551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7230-2c9a-4775-8a65-5ebf6f251caf admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:58.997165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cb234-fc46-46d3-9047-79070458e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:58.998031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cb234-fc46-46d3-9047-79070458e347 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:58.998309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cb234-fc46-46d3-9047-79070458e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:58.998581 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cb234-fc46-46d3-9047-79070458e347 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:58.999223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cb234-fc46-46d3-9047-79070458e347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:59.000828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cb234-fc46-46d3-9047-79070458e347 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:59.010968 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 993/1975] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:20:59.015167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2cde9-425a-404d-bace-ee5bcd458d58 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:59.025949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2cde9-425a-404d-bace-ee5bcd458d58 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:59.030889 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b9444-56ea-4482-8b87-f8e3bcb8f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:59.031533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9444-56ea-4482-8b87-f8e3bcb8f200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:59.031807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9444-56ea-4482-8b87-f8e3bcb8f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:59.032101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9444-56ea-4482-8b87-f8e3bcb8f200 admin admin] PATH_INFO: `/v3/projects/0f99d52cf5a84da4bccd74487d3ee95c/users/e0d637c75fe74899975d7d19dec9db38/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:59.034050 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b9444-56ea-4482-8b87-f8e3bcb8f200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f99d52cf5a84da4bccd74487d3ee95c, user_id=e0d637c75fe74899975d7d19dec9db38, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:59.037207 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b9444-56ea-4482-8b87-f8e3bcb8f200 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:59.047989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 983/1976] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:20:59 2022] PUT /identity/v3/projects/0f99d52cf5a84da4bccd74487d3ee95c/users/e0d637c75fe74899975d7d19dec9db38/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:20:59.058733 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ee425-f4d7-4c4f-830a-9e885fb9ee4b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:59.059197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ee425-f4d7-4c4f-830a-9e885fb9ee4b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:59.059282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ee425-f4d7-4c4f-830a-9e885fb9ee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:59.087849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-2c8ee425-f4d7-4c4f-830a-9e885fb9ee4b None None] MFA Rules not processed for user `e0d637c75fe74899975d7d19dec9db38`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:20:59.089087 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2c8ee425-f4d7-4c4f-830a-9e885fb9ee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:59.132377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:59.163606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 994/1977] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:20:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:20:59.174768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b9444-56ea-4482-8b87-f8e3bcb8f200 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:20:59.177609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-134b9444-56ea-4482-8b87-f8e3bcb8f200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:20:59.237196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b9444-56ea-4482-8b87-f8e3bcb8f200 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:20:59.241686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026e8c4-abca-4eea-aac9-a1f1e89a2658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:20:59.242300 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026e8c4-abca-4eea-aac9-a1f1e89a2658 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:20:59.242599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026e8c4-abca-4eea-aac9-a1f1e89a2658 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:20:59.242875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026e8c4-abca-4eea-aac9-a1f1e89a2658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:20:59.271807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:20:59.306551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026e8c4-abca-4eea-aac9-a1f1e89a2658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:20:59.308098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026e8c4-abca-4eea-aac9-a1f1e89a2658 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:20:59.318081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 984/1978] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:20:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:01.342924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ee425-f4d7-4c4f-830a-9e885fb9ee4b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:01.344404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2c8ee425-f4d7-4c4f-830a-9e885fb9ee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:01.356431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ee425-f4d7-4c4f-830a-9e885fb9ee4b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:01.360110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb04aa-4bd1-49e8-a566-42b12d0ec47b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:01.360739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb04aa-4bd1-49e8-a566-42b12d0ec47b service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:01.361044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb04aa-4bd1-49e8-a566-42b12d0ec47b service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:01.361317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb04aa-4bd1-49e8-a566-42b12d0ec47b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:01.424280 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb04aa-4bd1-49e8-a566-42b12d0ec47b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:01.425726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb04aa-4bd1-49e8-a566-42b12d0ec47b service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:01.439460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 995/1979] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:02.946976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026e8c4-abca-4eea-aac9-a1f1e89a2658 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:02.955659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026e8c4-abca-4eea-aac9-a1f1e89a2658 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:02.959342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1feb8d-6b25-44fa-b347-b72d6d64a4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:02.959992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1feb8d-6b25-44fa-b347-b72d6d64a4bc service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:02.960332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1feb8d-6b25-44fa-b347-b72d6d64a4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:02.960642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1feb8d-6b25-44fa-b347-b72d6d64a4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:02.969618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1feb8d-6b25-44fa-b347-b72d6d64a4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:02.971117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1feb8d-6b25-44fa-b347-b72d6d64a4bc service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:02.981255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 985/1980] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:03.795179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb04aa-4bd1-49e8-a566-42b12d0ec47b service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:03.796635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f2fb04aa-4bd1-49e8-a566-42b12d0ec47b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:03.865041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb04aa-4bd1-49e8-a566-42b12d0ec47b service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:03.869595 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:03.870224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:03.870503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:03.870772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] PATH_INFO: `/v3/users/85b93333fe3e46ee80bf89e30ca40068` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:03.871879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b93333fe3e46ee80bf89e30ca40068)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:03.874077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:04.071499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b93333fe3e46ee80bf89e30ca40068'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:04.078158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b93333fe3e46ee80bf89e30ca40068'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:04.078819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b93333fe3e46ee80bf89e30ca40068'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:04.161817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b93333fe3e46ee80bf89e30ca40068'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:04.178700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:04.183864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b93333fe3e46ee80bf89e30ca40068'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:04.190039 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 996/1981] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:03 2022] DELETE /identity/v3/users/85b93333fe3e46ee80bf89e30ca40068 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:04.195023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1f9ac-dc2c-4d7e-838d-4f99c4526c06 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:04.195485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1f9ac-dc2c-4d7e-838d-4f99c4526c06 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:04.195714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1f9ac-dc2c-4d7e-838d-4f99c4526c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:04.215555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-96b1f9ac-dc2c-4d7e-838d-4f99c4526c06 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:04.216790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-96b1f9ac-dc2c-4d7e-838d-4f99c4526c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:04.286388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 986/1982] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:04.302622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:04.305102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:04.376037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423e273-a046-4d11-9438-3d36c6924949 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:04.380367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12ff3d-3fa2-4581-b81c-40eefbf47ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:04.381180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12ff3d-3fa2-4581-b81c-40eefbf47ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:04.381546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12ff3d-3fa2-4581-b81c-40eefbf47ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:04.381880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12ff3d-3fa2-4581-b81c-40eefbf47ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:04.391449 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12ff3d-3fa2-4581-b81c-40eefbf47ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:04.393320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12ff3d-3fa2-4581-b81c-40eefbf47ce8 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:04.404819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 997/1983] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:04.921027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1f9ac-dc2c-4d7e-838d-4f99c4526c06 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:04.921027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-96b1f9ac-dc2c-4d7e-838d-4f99c4526c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:04.932385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1f9ac-dc2c-4d7e-838d-4f99c4526c06 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:04.938492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:04.949381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:04.949381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:04.949381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] PATH_INFO: `/v3/projects/54a0aac21aa3458d9e46c1c1654682e7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:04.949381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a0aac21aa3458d9e46c1c1654682e7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:04.949381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:05.090533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a0aac21aa3458d9e46c1c1654682e7', 'request_id': 'req-1ab6c378-4b9e-496d-9a22-675ac25e71a4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:05.098579 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a0aac21aa3458d9e46c1c1654682e7', 'request_id': 'req-1ab6c378-4b9e-496d-9a22-675ac25e71a4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:05.109820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a0aac21aa3458d9e46c1c1654682e7', 'request_id': 'req-1ab6c378-4b9e-496d-9a22-675ac25e71a4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:05.195377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] The token cache is being invalidate because project 54a0aac21aa3458d9e46c1c1654682e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:05.196024 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:05.196321 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ab6c378-4b9e-496d-9a22-675ac25e71a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:05.197848 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 987/1984] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:04 2022] DELETE /identity/v3/projects/54a0aac21aa3458d9e46c1c1654682e7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:05.202939 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d62ec-0e0b-4ae2-9f42-5f3d4f65e157 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:05.203749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d62ec-0e0b-4ae2-9f42-5f3d4f65e157 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:05.204054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d62ec-0e0b-4ae2-9f42-5f3d4f65e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:05.226150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-745d62ec-0e0b-4ae2-9f42-5f3d4f65e157 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:05.227421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-745d62ec-0e0b-4ae2-9f42-5f3d4f65e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:05.288467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 998/1985] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:05.296121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177076-5fb7-4521-90f9-0aee195931d9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:05.296434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177076-5fb7-4521-90f9-0aee195931d9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:05.296714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177076-5fb7-4521-90f9-0aee195931d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:05.317158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4c177076-5fb7-4521-90f9-0aee195931d9 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:05.318347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4c177076-5fb7-4521-90f9-0aee195931d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:05.326964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 988/1986] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:05.331341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d62ec-0e0b-4ae2-9f42-5f3d4f65e157 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:05.348862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d62ec-0e0b-4ae2-9f42-5f3d4f65e157 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:05.348862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9131ce3-5e04-4837-a111-cb14b4b6d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:05.348862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9131ce3-5e04-4837-a111-cb14b4b6d8ff admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:05.348862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9131ce3-5e04-4837-a111-cb14b4b6d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:05.349281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9131ce3-5e04-4837-a111-cb14b4b6d8ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:05.349281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9131ce3-5e04-4837-a111-cb14b4b6d8ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:21:05.349281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9131ce3-5e04-4837-a111-cb14b4b6d8ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:05.350646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9131ce3-5e04-4837-a111-cb14b4b6d8ff admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:05.362032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 999/1987] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:21:05.366336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c177076-5fb7-4521-90f9-0aee195931d9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:05.376222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c177076-5fb7-4521-90f9-0aee195931d9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:05.380870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc60117-3a74-4902-95ae-b0398a4786a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:05.381467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc60117-3a74-4902-95ae-b0398a4786a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:05.381744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc60117-3a74-4902-95ae-b0398a4786a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:05.382016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc60117-3a74-4902-95ae-b0398a4786a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:05.382657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc60117-3a74-4902-95ae-b0398a4786a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:05.384614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc60117-3a74-4902-95ae-b0398a4786a0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:05.460482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 989/1988] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:05 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:05.465410 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9131ce3-5e04-4837-a111-cb14b4b6d8ff admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:05.476613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9131ce3-5e04-4837-a111-cb14b4b6d8ff admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:05.539385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806b83-f3b5-4518-89f2-4a9c428e40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:05.539998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806b83-f3b5-4518-89f2-4a9c428e40ba admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:05.540310 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806b83-f3b5-4518-89f2-4a9c428e40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:05.540587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806b83-f3b5-4518-89f2-4a9c428e40ba admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:05.541219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806b83-f3b5-4518-89f2-4a9c428e40ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:05.543291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806b83-f3b5-4518-89f2-4a9c428e40ba admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:05.636425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1000/1989] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:05 2022] POST /identity/v3/users => generated 282 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:05.640679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc60117-3a74-4902-95ae-b0398a4786a0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:05.652416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc60117-3a74-4902-95ae-b0398a4786a0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:05.657372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb9e15-27e2-4abf-8c8e-1572cf522cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:05.657984 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb9e15-27e2-4abf-8c8e-1572cf522cee admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:05.658384 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb9e15-27e2-4abf-8c8e-1572cf522cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:05.658667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb9e15-27e2-4abf-8c8e-1572cf522cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:05.659346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb9e15-27e2-4abf-8c8e-1572cf522cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:05.661565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb9e15-27e2-4abf-8c8e-1572cf522cee admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:05.663203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:05.677755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 990/1990] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:05.679409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806b83-f3b5-4518-89f2-4a9c428e40ba admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:05.690680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806b83-f3b5-4518-89f2-4a9c428e40ba admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:05.698552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb1563-b6f7-4a85-8e93-a3501a02556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:05.699244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1563-b6f7-4a85-8e93-a3501a02556f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:05.699534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1563-b6f7-4a85-8e93-a3501a02556f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:05.702466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1563-b6f7-4a85-8e93-a3501a02556f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:05.702466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb1563-b6f7-4a85-8e93-a3501a02556f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:05.702466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb1563-b6f7-4a85-8e93-a3501a02556f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:05.708677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:05.714750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1001/1991] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:05.719218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb9e15-27e2-4abf-8c8e-1572cf522cee admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:05.729818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb9e15-27e2-4abf-8c8e-1572cf522cee admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:05.734596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf1424-2c1a-400d-8cad-d8b2760ea428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:05.735246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf1424-2c1a-400d-8cad-d8b2760ea428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:05.735523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf1424-2c1a-400d-8cad-d8b2760ea428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:05.735794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf1424-2c1a-400d-8cad-d8b2760ea428 admin admin] PATH_INFO: `/v3/projects/8b794cbfd17b411986431429dbdfb2fa/users/38db97e946b74c969536bfcb3e4d7a9f/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:05.751382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf1424-2c1a-400d-8cad-d8b2760ea428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b794cbfd17b411986431429dbdfb2fa, user_id=38db97e946b74c969536bfcb3e4d7a9f, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:05.754584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf1424-2c1a-400d-8cad-d8b2760ea428 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:05.864164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 991/1992] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:05 2022] PUT /identity/v3/projects/8b794cbfd17b411986431429dbdfb2fa/users/38db97e946b74c969536bfcb3e4d7a9f/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:05.874803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71290b-1223-43b1-9c02-6e1999332174 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:05.875128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71290b-1223-43b1-9c02-6e1999332174 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:05.875411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71290b-1223-43b1-9c02-6e1999332174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:05.905278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-eb71290b-1223-43b1-9c02-6e1999332174 None None] MFA Rules not processed for user `38db97e946b74c969536bfcb3e4d7a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:05.906425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-eb71290b-1223-43b1-9c02-6e1999332174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:05.976368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1002/1993] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:05.987887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf1424-2c1a-400d-8cad-d8b2760ea428 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:06.052812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf1424-2c1a-400d-8cad-d8b2760ea428 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:06.057722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760f970-e754-496d-985f-df0909b34888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:06.058337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760f970-e754-496d-985f-df0909b34888 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:06.058622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760f970-e754-496d-985f-df0909b34888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:06.058897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760f970-e754-496d-985f-df0909b34888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:06.059550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760f970-e754-496d-985f-df0909b34888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:06.061869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760f970-e754-496d-985f-df0909b34888 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:06.146510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 992/1994] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:05 2022] POST /identity/v3/projects => generated 363 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:06.150336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71290b-1223-43b1-9c02-6e1999332174 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:06.161360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71290b-1223-43b1-9c02-6e1999332174 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:06.220066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117a56-9a06-4075-bb27-8dfead4b624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:06.220771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117a56-9a06-4075-bb27-8dfead4b624e admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:06.221019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117a56-9a06-4075-bb27-8dfead4b624e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:06.221296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117a56-9a06-4075-bb27-8dfead4b624e admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:06.221931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36117a56-9a06-4075-bb27-8dfead4b624e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:06.223942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36117a56-9a06-4075-bb27-8dfead4b624e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:06.311476 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1003/1995] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:06 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:06.314739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760f970-e754-496d-985f-df0909b34888 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:06.326025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760f970-e754-496d-985f-df0909b34888 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:06.331338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9f036-eacf-41ba-a533-3c907f7778b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:06.331945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f036-eacf-41ba-a533-3c907f7778b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:06.332240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f036-eacf-41ba-a533-3c907f7778b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:06.335589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f036-eacf-41ba-a533-3c907f7778b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:06.335589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9f036-eacf-41ba-a533-3c907f7778b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:06.335589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9f036-eacf-41ba-a533-3c907f7778b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:06.345601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 993/1996] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:06.349892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117a56-9a06-4075-bb27-8dfead4b624e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:06.359941 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117a56-9a06-4075-bb27-8dfead4b624e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:06.365390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc2f3-14ac-48a6-b5bc-5dd4cebeded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:06.366035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc2f3-14ac-48a6-b5bc-5dd4cebeded6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:06.366316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc2f3-14ac-48a6-b5bc-5dd4cebeded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:06.366591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cc2f3-14ac-48a6-b5bc-5dd4cebeded6 admin admin] PATH_INFO: `/v3/projects/9c82acb571694d64af962b1b1512a313/users/23c0ee2ba0a54e168c82930ac07fcf1c/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:06.383190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc2f3-14ac-48a6-b5bc-5dd4cebeded6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c82acb571694d64af962b1b1512a313, user_id=23c0ee2ba0a54e168c82930ac07fcf1c, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:06.385946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cc2f3-14ac-48a6-b5bc-5dd4cebeded6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:06.476961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1004/1997] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:06 2022] PUT /identity/v3/projects/9c82acb571694d64af962b1b1512a313/users/23c0ee2ba0a54e168c82930ac07fcf1c/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:06.481067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9f036-eacf-41ba-a533-3c907f7778b7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:06.491987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9f036-eacf-41ba-a533-3c907f7778b7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:06.548871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd041e-8402-4993-ae5b-55dbe2e460c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:06.549505 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd041e-8402-4993-ae5b-55dbe2e460c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:06.549766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd041e-8402-4993-ae5b-55dbe2e460c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:06.550041 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd041e-8402-4993-ae5b-55dbe2e460c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:06.551338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd041e-8402-4993-ae5b-55dbe2e460c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:06.552966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd041e-8402-4993-ae5b-55dbe2e460c9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:06.563047 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 994/1998] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:06.567604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc2f3-14ac-48a6-b5bc-5dd4cebeded6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:06.579516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cc2f3-14ac-48a6-b5bc-5dd4cebeded6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:06.584754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c14188-4265-4339-80af-4a4d195898d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:06.585445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c14188-4265-4339-80af-4a4d195898d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:06.585725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c14188-4265-4339-80af-4a4d195898d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:06.586002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c14188-4265-4339-80af-4a4d195898d8 admin admin] PATH_INFO: `/v3/projects/9c82acb571694d64af962b1b1512a313/users/23c0ee2ba0a54e168c82930ac07fcf1c/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:06.587943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c14188-4265-4339-80af-4a4d195898d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c82acb571694d64af962b1b1512a313, user_id=23c0ee2ba0a54e168c82930ac07fcf1c, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:06.590698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c14188-4265-4339-80af-4a4d195898d8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:06.602485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1005/1999] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:06 2022] PUT /identity/v3/projects/9c82acb571694d64af962b1b1512a313/users/23c0ee2ba0a54e168c82930ac07fcf1c/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:06.615038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de892-fcf0-4b4d-89a9-8e931c9276b7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:06.615324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de892-fcf0-4b4d-89a9-8e931c9276b7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:06.615602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de892-fcf0-4b4d-89a9-8e931c9276b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:06.643152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dd3de892-fcf0-4b4d-89a9-8e931c9276b7 None None] MFA Rules not processed for user `23c0ee2ba0a54e168c82930ac07fcf1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:06.644461 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd3de892-fcf0-4b4d-89a9-8e931c9276b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:06.675088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:06.712713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 995/2000] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:21:06.724780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c14188-4265-4339-80af-4a4d195898d8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:06.726609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-49c14188-4265-4339-80af-4a4d195898d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:06.775149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:06.793872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c14188-4265-4339-80af-4a4d195898d8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:06.797885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f39f-c910-48ba-bf78-53dc96b52ad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:06.811388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f39f-c910-48ba-bf78-53dc96b52ad4 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:06.811388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f39f-c910-48ba-bf78-53dc96b52ad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:06.811388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f39f-c910-48ba-bf78-53dc96b52ad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:06.811388 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14f39f-c910-48ba-bf78-53dc96b52ad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:06.811924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14f39f-c910-48ba-bf78-53dc96b52ad4 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:06.822015 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1006/2001] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:07.112748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de892-fcf0-4b4d-89a9-8e931c9276b7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:07.114203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd3de892-fcf0-4b4d-89a9-8e931c9276b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:07.126405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de892-fcf0-4b4d-89a9-8e931c9276b7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:07.129942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b673def-c7d5-429f-83f0-e17eefb3547c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:07.130544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b673def-c7d5-429f-83f0-e17eefb3547c service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:07.130821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b673def-c7d5-429f-83f0-e17eefb3547c service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:07.131100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b673def-c7d5-429f-83f0-e17eefb3547c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:07.190038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b673def-c7d5-429f-83f0-e17eefb3547c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:07.192008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b673def-c7d5-429f-83f0-e17eefb3547c service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:07.201017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 996/2002] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:08.893599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f39f-c910-48ba-bf78-53dc96b52ad4 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:08.895612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cb14f39f-c910-48ba-bf78-53dc96b52ad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:08.974537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f39f-c910-48ba-bf78-53dc96b52ad4 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:08.979938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:08.980617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:08.980897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:08.981191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] PATH_INFO: `/v3/users/1abc9d739c254ccb8b70ee24d09273d3` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:08.982454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1abc9d739c254ccb8b70ee24d09273d3)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:08.986793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:09.252490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1abc9d739c254ccb8b70ee24d09273d3'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:09.261215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1abc9d739c254ccb8b70ee24d09273d3'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:09.261980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1abc9d739c254ccb8b70ee24d09273d3'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:09.366781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1abc9d739c254ccb8b70ee24d09273d3'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:09.381313 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1abc9d739c254ccb8b70ee24d09273d3'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:09.387846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1007/2003] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:08 2022] DELETE /identity/v3/users/1abc9d739c254ccb8b70ee24d09273d3 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:09.392613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae250f18-76ef-4906-85b5-9e6030169711 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:09.393120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae250f18-76ef-4906-85b5-9e6030169711 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:09.393214 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae250f18-76ef-4906-85b5-9e6030169711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:09.417358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ae250f18-76ef-4906-85b5-9e6030169711 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:09.424905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ae250f18-76ef-4906-85b5-9e6030169711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:09.512141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 997/2004] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:09.522371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:09.524364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:09.603194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be6e99-a572-45d6-8166-8f6d91155e04 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:09.611509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a2e00-2e2d-4416-a58a-cc95aa4ee152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:09.611509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2e00-2e2d-4416-a58a-cc95aa4ee152 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:09.611509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2e00-2e2d-4416-a58a-cc95aa4ee152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:09.611509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a2e00-2e2d-4416-a58a-cc95aa4ee152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:09.619147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a2e00-2e2d-4416-a58a-cc95aa4ee152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:09.620631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a2e00-2e2d-4416-a58a-cc95aa4ee152 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:09.631234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1008/2005] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:10.094161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae250f18-76ef-4906-85b5-9e6030169711 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:10.095606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ae250f18-76ef-4906-85b5-9e6030169711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:10.108774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae250f18-76ef-4906-85b5-9e6030169711 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:10.113506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:10.114145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:10.114417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:10.114687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] PATH_INFO: `/v3/projects/b9ff643e4104444a9072e840353dd816` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:10.115816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ff643e4104444a9072e840353dd816)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:10.117760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:10.235496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ff643e4104444a9072e840353dd816', 'request_id': 'req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:10.241710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ff643e4104444a9072e840353dd816', 'request_id': 'req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:10.246392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:10.247818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ff643e4104444a9072e840353dd816', 'request_id': 'req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:10.333218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] The token cache is being invalidate because project b9ff643e4104444a9072e840353dd816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:10.333512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:10.334158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:10.335682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 998/2006] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:10 2022] DELETE /identity/v3/projects/b9ff643e4104444a9072e840353dd816 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:10.340101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a2e00-2e2d-4416-a58a-cc95aa4ee152 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:10.349791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a2e00-2e2d-4416-a58a-cc95aa4ee152 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:10.354022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:10.408354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:10.408853 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:10.409138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:10.409424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] PATH_INFO: `/v3/users/a9446ef790e54aecaa6983d76751ef8d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:10.410704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9446ef790e54aecaa6983d76751ef8d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:10.412805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:10.663398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9446ef790e54aecaa6983d76751ef8d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:10.670960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9446ef790e54aecaa6983d76751ef8d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:10.671921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9446ef790e54aecaa6983d76751ef8d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:10.756028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9446ef790e54aecaa6983d76751ef8d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:10.768688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9446ef790e54aecaa6983d76751ef8d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:10.774732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1009/2007] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:10 2022] DELETE /identity/v3/users/a9446ef790e54aecaa6983d76751ef8d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:11.225891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:11.228185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:11.243671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa925f6a-cf02-42b7-a9ee-06c81e58ae2d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:11.329389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:11.330033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:11.330419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:11.330743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] PATH_INFO: `/v3/projects/1f33f9a22b664f5ba6470255b9919c32` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:11.332518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f33f9a22b664f5ba6470255b9919c32)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:11.334447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:11.448564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f33f9a22b664f5ba6470255b9919c32', 'request_id': 'req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:11.455187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f33f9a22b664f5ba6470255b9919c32', 'request_id': 'req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:11.461787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f33f9a22b664f5ba6470255b9919c32', 'request_id': 'req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:11.573084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] The token cache is being invalidate because project 1f33f9a22b664f5ba6470255b9919c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:11.573444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:11.574022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:11.579188 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 999/2008] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:11 2022] DELETE /identity/v3/projects/1f33f9a22b664f5ba6470255b9919c32 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:11.580591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:11.582668 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:11.595749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140568c2-5c2d-4670-9967-756d732ea3e3 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:11.663493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:11.664549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:11.664935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:11.665434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] PATH_INFO: `/v3/users/e0d637c75fe74899975d7d19dec9db38` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:11.666696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d637c75fe74899975d7d19dec9db38)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:11.668721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:11.764820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:11.860555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d637c75fe74899975d7d19dec9db38'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:11.867761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d637c75fe74899975d7d19dec9db38'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:11.868585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d637c75fe74899975d7d19dec9db38'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:11.950152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d637c75fe74899975d7d19dec9db38'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:11.963776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-048f2c2a-41e9-444f-a554-5e1cdce4e6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d637c75fe74899975d7d19dec9db38'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:11.969721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1010/2009] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:11 2022] DELETE /identity/v3/users/e0d637c75fe74899975d7d19dec9db38 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:12.357089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:12.358636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:12.372107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a11530-d4bb-4ce5-9bc2-0aae57b20a98 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:12.450425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:12.451070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:12.451358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:12.451640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] PATH_INFO: `/v3/projects/0f99d52cf5a84da4bccd74487d3ee95c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:12.452808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f99d52cf5a84da4bccd74487d3ee95c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:12.455024 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:12.479781 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:12.557266 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f99d52cf5a84da4bccd74487d3ee95c', 'request_id': 'req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:12.563461 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f99d52cf5a84da4bccd74487d3ee95c', 'request_id': 'req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:12.568975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f99d52cf5a84da4bccd74487d3ee95c', 'request_id': 'req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:12.663784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] The token cache is being invalidate because project 0f99d52cf5a84da4bccd74487d3ee95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:12.664097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:12.664754 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9df2dbb1-2c2a-4e9e-8f3b-4eae635440af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:12.666521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1000/2010] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:12 2022] DELETE /identity/v3/projects/0f99d52cf5a84da4bccd74487d3ee95c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:12.673475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291d63-9592-49b7-9f91-45d1bd290e43 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:12.673475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291d63-9592-49b7-9f91-45d1bd290e43 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:12.673475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291d63-9592-49b7-9f91-45d1bd290e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:12.695442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f2291d63-9592-49b7-9f91-45d1bd290e43 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:12.696877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f2291d63-9592-49b7-9f91-45d1bd290e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:12.766069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1011/2011] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:12.775249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055efc74-781a-437f-86ee-97ef680a701d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:12.775531 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055efc74-781a-437f-86ee-97ef680a701d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:12.775875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055efc74-781a-437f-86ee-97ef680a701d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:12.796057 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-055efc74-781a-437f-86ee-97ef680a701d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:12.797343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-055efc74-781a-437f-86ee-97ef680a701d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:12.806009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1001/2012] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:12.810288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2291d63-9592-49b7-9f91-45d1bd290e43 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:12.819902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2291d63-9592-49b7-9f91-45d1bd290e43 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:12.824544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa5de-b253-4064-a804-085ecb23bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:12.825138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa5de-b253-4064-a804-085ecb23bcdf admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:12.825417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa5de-b253-4064-a804-085ecb23bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:12.825684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa5de-b253-4064-a804-085ecb23bcdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:12.826320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfa5de-b253-4064-a804-085ecb23bcdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:21:12.826634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfa5de-b253-4064-a804-085ecb23bcdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:12.828254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfa5de-b253-4064-a804-085ecb23bcdf admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:12.844291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1012/2013] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:21:12.845275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055efc74-781a-437f-86ee-97ef680a701d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:12.855331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055efc74-781a-437f-86ee-97ef680a701d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:12.860221 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbe828-ee88-4753-a4fa-acd046f01e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:12.860838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe828-ee88-4753-a4fa-acd046f01e8e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:12.861114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe828-ee88-4753-a4fa-acd046f01e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:12.861387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe828-ee88-4753-a4fa-acd046f01e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:12.862054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbe828-ee88-4753-a4fa-acd046f01e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:12.864148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbe828-ee88-4753-a4fa-acd046f01e8e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:12.970453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1002/2014] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:12 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:12.975332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa5de-b253-4064-a804-085ecb23bcdf admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:12.985742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa5de-b253-4064-a804-085ecb23bcdf admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:13.063860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07e4d-fdbd-4f19-9ef5-44a89c2490bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:13.064721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07e4d-fdbd-4f19-9ef5-44a89c2490bc admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:13.065799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07e4d-fdbd-4f19-9ef5-44a89c2490bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:13.066280 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07e4d-fdbd-4f19-9ef5-44a89c2490bc admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:13.067084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d07e4d-fdbd-4f19-9ef5-44a89c2490bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:13.069082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d07e4d-fdbd-4f19-9ef5-44a89c2490bc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:13.138583 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1013/2015] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:12 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:21:13.142920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbe828-ee88-4753-a4fa-acd046f01e8e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:13.153870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbe828-ee88-4753-a4fa-acd046f01e8e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:13.158740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c08fa3-597d-4de0-a812-76c0fb709432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:13.159419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c08fa3-597d-4de0-a812-76c0fb709432 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:13.159765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c08fa3-597d-4de0-a812-76c0fb709432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:13.160723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c08fa3-597d-4de0-a812-76c0fb709432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:13.161371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c08fa3-597d-4de0-a812-76c0fb709432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:13.162966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c08fa3-597d-4de0-a812-76c0fb709432 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:13.173605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1003/2016] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:13.181693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07e4d-fdbd-4f19-9ef5-44a89c2490bc admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:13.191780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07e4d-fdbd-4f19-9ef5-44a89c2490bc admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:13.196865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b050e-0abf-4be5-a7d5-c5586e1d8261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:13.197485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b050e-0abf-4be5-a7d5-c5586e1d8261 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:13.197762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b050e-0abf-4be5-a7d5-c5586e1d8261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:13.198030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b050e-0abf-4be5-a7d5-c5586e1d8261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:13.198665 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b050e-0abf-4be5-a7d5-c5586e1d8261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:13.200264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b050e-0abf-4be5-a7d5-c5586e1d8261 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:13.211698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1014/2017] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:13.215847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c08fa3-597d-4de0-a812-76c0fb709432 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:13.225886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c08fa3-597d-4de0-a812-76c0fb709432 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:13.230588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30656b20-f6e2-463b-9816-f9bb922dfe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:13.231217 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30656b20-f6e2-463b-9816-f9bb922dfe84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:13.231487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30656b20-f6e2-463b-9816-f9bb922dfe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:13.231759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30656b20-f6e2-463b-9816-f9bb922dfe84 admin admin] PATH_INFO: `/v3/projects/22199acbbd0d404fbd22bdfa0ef2519d/users/82d9d5ae24134300879eb34732a9dff3/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:13.250762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30656b20-f6e2-463b-9816-f9bb922dfe84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22199acbbd0d404fbd22bdfa0ef2519d, user_id=82d9d5ae24134300879eb34732a9dff3, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:13.253450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30656b20-f6e2-463b-9816-f9bb922dfe84 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:13.336624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1004/2018] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:13 2022] PUT /identity/v3/projects/22199acbbd0d404fbd22bdfa0ef2519d/users/82d9d5ae24134300879eb34732a9dff3/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:13.347074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d956317-1cf9-4584-9528-8fe5f7deb939 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:13.350186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d956317-1cf9-4584-9528-8fe5f7deb939 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:13.350186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d956317-1cf9-4584-9528-8fe5f7deb939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:13.376695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:13.385481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0d956317-1cf9-4584-9528-8fe5f7deb939 None None] MFA Rules not processed for user `82d9d5ae24134300879eb34732a9dff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:13.386819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0d956317-1cf9-4584-9528-8fe5f7deb939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:13.453291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1015/2019] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:13.465625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30656b20-f6e2-463b-9816-f9bb922dfe84 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:13.467605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-30656b20-f6e2-463b-9816-f9bb922dfe84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:13.526407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30656b20-f6e2-463b-9816-f9bb922dfe84 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:13.530183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16a5ce-e652-4996-9794-a5a94c5e98d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b84587baf0432c800a6278d7095cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:13.530907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16a5ce-e652-4996-9794-a5a94c5e98d8 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:13.531190 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16a5ce-e652-4996-9794-a5a94c5e98d8 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:13.531466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16a5ce-e652-4996-9794-a5a94c5e98d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:13.539878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16a5ce-e652-4996-9794-a5a94c5e98d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:13.541345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16a5ce-e652-4996-9794-a5a94c5e98d8 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:13.550146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1005/2020] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:17.262608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d956317-1cf9-4584-9528-8fe5f7deb939 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:17.264018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0d956317-1cf9-4584-9528-8fe5f7deb939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:17.331992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d956317-1cf9-4584-9528-8fe5f7deb939 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:17.338149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:17.338784 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:17.339120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:17.339471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] PATH_INFO: `/v3/users/38db97e946b74c969536bfcb3e4d7a9f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:17.340800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38db97e946b74c969536bfcb3e4d7a9f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:17.343418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:17.527699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38db97e946b74c969536bfcb3e4d7a9f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:17.535335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38db97e946b74c969536bfcb3e4d7a9f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:17.536079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38db97e946b74c969536bfcb3e4d7a9f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:17.624634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38db97e946b74c969536bfcb3e4d7a9f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:17.638488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38db97e946b74c969536bfcb3e4d7a9f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:17.644859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1016/2021] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:17 2022] DELETE /identity/v3/users/38db97e946b74c969536bfcb3e4d7a9f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:17.649389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cadb7a-5bfe-4044-b608-9c0b03baeb38 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:17.649921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cadb7a-5bfe-4044-b608-9c0b03baeb38 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:17.649921 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cadb7a-5bfe-4044-b608-9c0b03baeb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:17.670162 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-41cadb7a-5bfe-4044-b608-9c0b03baeb38 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:17.671387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-41cadb7a-5bfe-4044-b608-9c0b03baeb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:17.725622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:17.740301 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1006/2022] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:21:17.750368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:17.751893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:17.774591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:17.812035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fbe18-4e91-4a35-896c-207318285026 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:17.815892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19aa64-7541-4971-91c5-8529d5b064d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:17.816730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19aa64-7541-4971-91c5-8529d5b064d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:17.827147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19aa64-7541-4971-91c5-8529d5b064d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:17.827147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19aa64-7541-4971-91c5-8529d5b064d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:17.828665 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19aa64-7541-4971-91c5-8529d5b064d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:17.830618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19aa64-7541-4971-91c5-8529d5b064d5 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:17.847314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1017/2023] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:18.274081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cadb7a-5bfe-4044-b608-9c0b03baeb38 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:18.276134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-41cadb7a-5bfe-4044-b608-9c0b03baeb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:18.292906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cadb7a-5bfe-4044-b608-9c0b03baeb38 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:18.297758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:18.298401 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:18.298683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:18.299165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] PATH_INFO: `/v3/projects/8b794cbfd17b411986431429dbdfb2fa` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:18.300737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b794cbfd17b411986431429dbdfb2fa)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:18.303485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:18.397365 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b794cbfd17b411986431429dbdfb2fa', 'request_id': 'req-ac79c489-7be2-42bd-911c-9e0db2804375'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:18.403667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b794cbfd17b411986431429dbdfb2fa', 'request_id': 'req-ac79c489-7be2-42bd-911c-9e0db2804375'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:18.409315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b794cbfd17b411986431429dbdfb2fa', 'request_id': 'req-ac79c489-7be2-42bd-911c-9e0db2804375'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:18.459180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] The token cache is being invalidate because project 8b794cbfd17b411986431429dbdfb2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:18.459467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:18.460117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:18.461641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1007/2024] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:18 2022] DELETE /identity/v3/projects/8b794cbfd17b411986431429dbdfb2fa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:18.465715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19aa64-7541-4971-91c5-8529d5b064d5 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:18.475294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19aa64-7541-4971-91c5-8529d5b064d5 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:18.534506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:18.535143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:18.535427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:18.535739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] PATH_INFO: `/v3/users/23c0ee2ba0a54e168c82930ac07fcf1c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:18.536883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c0ee2ba0a54e168c82930ac07fcf1c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:18.538843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:18.684621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c0ee2ba0a54e168c82930ac07fcf1c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:18.692491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c0ee2ba0a54e168c82930ac07fcf1c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:18.693238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c0ee2ba0a54e168c82930ac07fcf1c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:18.766965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c0ee2ba0a54e168c82930ac07fcf1c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:18.781132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-990b0d11-4e00-42ad-bb69-7724067392ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c0ee2ba0a54e168c82930ac07fcf1c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:18.788069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1018/2025] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:18 2022] DELETE /identity/v3/users/23c0ee2ba0a54e168c82930ac07fcf1c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:19.232635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:19.234179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:19.249125 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79c489-7be2-42bd-911c-9e0db2804375 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:19.310911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:19.311540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:19.311815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:19.312085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] PATH_INFO: `/v3/projects/9c82acb571694d64af962b1b1512a313` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:19.313236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c82acb571694d64af962b1b1512a313)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:19.315127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:19.427744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c82acb571694d64af962b1b1512a313', 'request_id': 'req-c74f6fe8-7592-4bed-ae15-ce3719375740'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:19.434672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c82acb571694d64af962b1b1512a313', 'request_id': 'req-c74f6fe8-7592-4bed-ae15-ce3719375740'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:19.440237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c82acb571694d64af962b1b1512a313', 'request_id': 'req-c74f6fe8-7592-4bed-ae15-ce3719375740'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:19.521578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] The token cache is being invalidate because project 9c82acb571694d64af962b1b1512a313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:19.521872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:19.522503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c74f6fe8-7592-4bed-ae15-ce3719375740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:19.524023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1008/2026] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:19 2022] DELETE /identity/v3/projects/9c82acb571694d64af962b1b1512a313 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:19.528981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02dc4f-bda6-4724-bd14-22c2ad8192a6 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:19.534385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02dc4f-bda6-4724-bd14-22c2ad8192a6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:19.534385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02dc4f-bda6-4724-bd14-22c2ad8192a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:19.549976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4d02dc4f-bda6-4724-bd14-22c2ad8192a6 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:19.551186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4d02dc4f-bda6-4724-bd14-22c2ad8192a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:19.591782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:19.613346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1019/2027] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:19.621683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2626b7-0417-48a7-9c57-ae6985c1c923 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:19.621967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2626b7-0417-48a7-9c57-ae6985c1c923 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:19.622249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2626b7-0417-48a7-9c57-ae6985c1c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:19.630089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:19.642278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dd2626b7-0417-48a7-9c57-ae6985c1c923 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:19.643502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd2626b7-0417-48a7-9c57-ae6985c1c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:19.652038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1009/2028] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:19.656657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02dc4f-bda6-4724-bd14-22c2ad8192a6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:19.668161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02dc4f-bda6-4724-bd14-22c2ad8192a6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:19.673186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ad620-657f-4757-a4c5-ee38c26421eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:19.673803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ad620-657f-4757-a4c5-ee38c26421eb admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:19.674184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ad620-657f-4757-a4c5-ee38c26421eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:19.674498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ad620-657f-4757-a4c5-ee38c26421eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:19.675189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ad620-657f-4757-a4c5-ee38c26421eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:21:19.675470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ad620-657f-4757-a4c5-ee38c26421eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:19.677193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ad620-657f-4757-a4c5-ee38c26421eb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:19.690737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1020/2029] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:21:19.695197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2626b7-0417-48a7-9c57-ae6985c1c923 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:19.704802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2626b7-0417-48a7-9c57-ae6985c1c923 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:19.711296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143fbec-006d-4bbc-8866-07aea3dbefc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:19.712048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143fbec-006d-4bbc-8866-07aea3dbefc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:19.712371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143fbec-006d-4bbc-8866-07aea3dbefc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:19.712641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143fbec-006d-4bbc-8866-07aea3dbefc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:19.713280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143fbec-006d-4bbc-8866-07aea3dbefc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:19.715171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143fbec-006d-4bbc-8866-07aea3dbefc5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:19.808965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1010/2030] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:19 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:19.813576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ad620-657f-4757-a4c5-ee38c26421eb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:19.825044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ad620-657f-4757-a4c5-ee38c26421eb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:19.886477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796eb89-df9f-4b33-8a8e-0fcab407da7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:19.887113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796eb89-df9f-4b33-8a8e-0fcab407da7d admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:19.887412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796eb89-df9f-4b33-8a8e-0fcab407da7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:19.887669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796eb89-df9f-4b33-8a8e-0fcab407da7d admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:19.888358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796eb89-df9f-4b33-8a8e-0fcab407da7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:19.890284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796eb89-df9f-4b33-8a8e-0fcab407da7d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:19.973906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1021/2031] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:19 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:19.978270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143fbec-006d-4bbc-8866-07aea3dbefc5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:19.988647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143fbec-006d-4bbc-8866-07aea3dbefc5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:19.993545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fc784-dabc-420b-a28b-ddf169b9bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:19.994148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fc784-dabc-420b-a28b-ddf169b9bf8f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:19.994425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fc784-dabc-420b-a28b-ddf169b9bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:19.994695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fc784-dabc-420b-a28b-ddf169b9bf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:19.995335 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fc784-dabc-420b-a28b-ddf169b9bf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:19.996943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fc784-dabc-420b-a28b-ddf169b9bf8f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:20.007668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1011/2032] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:20.011666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796eb89-df9f-4b33-8a8e-0fcab407da7d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:20.022353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796eb89-df9f-4b33-8a8e-0fcab407da7d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:20.027034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c879977-db9c-4765-98e2-44491880f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:20.027630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c879977-db9c-4765-98e2-44491880f844 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:20.027915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c879977-db9c-4765-98e2-44491880f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:20.028193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c879977-db9c-4765-98e2-44491880f844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:20.028873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c879977-db9c-4765-98e2-44491880f844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:20.030462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c879977-db9c-4765-98e2-44491880f844 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:20.041200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1022/2033] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:20.046985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fc784-dabc-420b-a28b-ddf169b9bf8f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:20.057077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fc784-dabc-420b-a28b-ddf169b9bf8f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:20.061663 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c571589-0acb-4314-9611-0e9f5867c9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:20.063303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c571589-0acb-4314-9611-0e9f5867c9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:20.063303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c571589-0acb-4314-9611-0e9f5867c9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:20.063303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c571589-0acb-4314-9611-0e9f5867c9ba admin admin] PATH_INFO: `/v3/projects/a97cd54367e0434394e7ae5d3245ffd7/users/97af724e5b384c8a9acc4396427894da/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:20.079607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c571589-0acb-4314-9611-0e9f5867c9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97cd54367e0434394e7ae5d3245ffd7, user_id=97af724e5b384c8a9acc4396427894da, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:20.082140 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c571589-0acb-4314-9611-0e9f5867c9ba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:20.157309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1012/2034] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:20 2022] PUT /identity/v3/projects/a97cd54367e0434394e7ae5d3245ffd7/users/97af724e5b384c8a9acc4396427894da/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:20.172591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b06eb1-b9ae-448c-933b-8f66c84f02b1 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:20.172874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b06eb1-b9ae-448c-933b-8f66c84f02b1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:20.173151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b06eb1-b9ae-448c-933b-8f66c84f02b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:20.207518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f0b06eb1-b9ae-448c-933b-8f66c84f02b1 None None] MFA Rules not processed for user `97af724e5b384c8a9acc4396427894da`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:20.208777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f0b06eb1-b9ae-448c-933b-8f66c84f02b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:20.273590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1023/2035] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:20.278281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c571589-0acb-4314-9611-0e9f5867c9ba admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:20.345247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c571589-0acb-4314-9611-0e9f5867c9ba admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:20.350777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58737-2318-4b4e-b5a7-667cd30129ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:20.351386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58737-2318-4b4e-b5a7-667cd30129ef admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:20.351667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58737-2318-4b4e-b5a7-667cd30129ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:20.351943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc58737-2318-4b4e-b5a7-667cd30129ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:20.352611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc58737-2318-4b4e-b5a7-667cd30129ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:20.354543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc58737-2318-4b4e-b5a7-667cd30129ef admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:20.442899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1013/2036] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:20 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:20.447182 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b06eb1-b9ae-448c-933b-8f66c84f02b1 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:20.458277 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b06eb1-b9ae-448c-933b-8f66c84f02b1 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:20.493940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:20.516565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7745d-c338-4dd8-b7fc-d7f7a5a43939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:20.517185 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7745d-c338-4dd8-b7fc-d7f7a5a43939 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:20.517467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7745d-c338-4dd8-b7fc-d7f7a5a43939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:20.517743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7745d-c338-4dd8-b7fc-d7f7a5a43939 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:20.518381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7745d-c338-4dd8-b7fc-d7f7a5a43939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:20.520334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7745d-c338-4dd8-b7fc-d7f7a5a43939 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:20.654835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1024/2037] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:20 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:20.658765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58737-2318-4b4e-b5a7-667cd30129ef admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:20.669137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc58737-2318-4b4e-b5a7-667cd30129ef admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:20.673754 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1722323-0cdd-4db6-8fd9-6a6feccda6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:20.674354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1722323-0cdd-4db6-8fd9-6a6feccda6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:20.674632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1722323-0cdd-4db6-8fd9-6a6feccda6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:20.674905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1722323-0cdd-4db6-8fd9-6a6feccda6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:20.675564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1722323-0cdd-4db6-8fd9-6a6feccda6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:20.677170 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1722323-0cdd-4db6-8fd9-6a6feccda6e4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:20.688290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1014/2038] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:20.692596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7745d-c338-4dd8-b7fc-d7f7a5a43939 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:20.703944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7745d-c338-4dd8-b7fc-d7f7a5a43939 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:20.708810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea90d0b-85d2-4bcc-80cd-ee98af6a262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:20.710018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea90d0b-85d2-4bcc-80cd-ee98af6a262d admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:20.710300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea90d0b-85d2-4bcc-80cd-ee98af6a262d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:20.710602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea90d0b-85d2-4bcc-80cd-ee98af6a262d admin admin] PATH_INFO: `/v3/projects/75c02922f9184cd3813f3d1576d27fa7/users/56bbfa5be556447699fa79e0dbe9972b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:20.725417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea90d0b-85d2-4bcc-80cd-ee98af6a262d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c02922f9184cd3813f3d1576d27fa7, user_id=56bbfa5be556447699fa79e0dbe9972b, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:20.728083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea90d0b-85d2-4bcc-80cd-ee98af6a262d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:20.790677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1025/2039] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:20 2022] PUT /identity/v3/projects/75c02922f9184cd3813f3d1576d27fa7/users/56bbfa5be556447699fa79e0dbe9972b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:20.798579 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1722323-0cdd-4db6-8fd9-6a6feccda6e4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:20.809781 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1722323-0cdd-4db6-8fd9-6a6feccda6e4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:20.868346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baa7d8-e273-412d-bca1-91b2826b600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:20.868926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baa7d8-e273-412d-bca1-91b2826b600f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:20.869213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baa7d8-e273-412d-bca1-91b2826b600f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:20.869489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baa7d8-e273-412d-bca1-91b2826b600f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:20.870265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baa7d8-e273-412d-bca1-91b2826b600f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:20.872309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baa7d8-e273-412d-bca1-91b2826b600f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:20.885557 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1015/2040] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:20.889236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea90d0b-85d2-4bcc-80cd-ee98af6a262d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:20.900318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea90d0b-85d2-4bcc-80cd-ee98af6a262d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:20.905125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681b663-4224-4fc6-babf-8701950bb4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:20.906693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681b663-4224-4fc6-babf-8701950bb4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:20.906974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681b663-4224-4fc6-babf-8701950bb4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:20.907254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681b663-4224-4fc6-babf-8701950bb4ef admin admin] PATH_INFO: `/v3/projects/75c02922f9184cd3813f3d1576d27fa7/users/56bbfa5be556447699fa79e0dbe9972b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:20.909333 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681b663-4224-4fc6-babf-8701950bb4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c02922f9184cd3813f3d1576d27fa7, user_id=56bbfa5be556447699fa79e0dbe9972b, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:20.911952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681b663-4224-4fc6-babf-8701950bb4ef admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:20.922243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1026/2041] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:20 2022] PUT /identity/v3/projects/75c02922f9184cd3813f3d1576d27fa7/users/56bbfa5be556447699fa79e0dbe9972b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:20.933852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1860a-e7d7-4985-b3a5-6d6b6f52c203 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:20.934229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1860a-e7d7-4985-b3a5-6d6b6f52c203 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:20.934544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1860a-e7d7-4985-b3a5-6d6b6f52c203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:20.954431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:20.963481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5aa1860a-e7d7-4985-b3a5-6d6b6f52c203 None None] MFA Rules not processed for user `56bbfa5be556447699fa79e0dbe9972b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:20.964735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5aa1860a-e7d7-4985-b3a5-6d6b6f52c203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:21.036408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1016/2042] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:21.048612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681b663-4224-4fc6-babf-8701950bb4ef admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:21.050439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d681b663-4224-4fc6-babf-8701950bb4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:21.111318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681b663-4224-4fc6-babf-8701950bb4ef admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:21.115049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee874d2-b5fa-4ff7-88b5-2aae941466cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:21.115743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee874d2-b5fa-4ff7-88b5-2aae941466cb service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:21.116033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee874d2-b5fa-4ff7-88b5-2aae941466cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:21.116334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee874d2-b5fa-4ff7-88b5-2aae941466cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:21.126170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee874d2-b5fa-4ff7-88b5-2aae941466cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:21.127725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee874d2-b5fa-4ff7-88b5-2aae941466cb service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:21.137384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1027/2043] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:21.166852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1860a-e7d7-4985-b3a5-6d6b6f52c203 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:21.234304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1860a-e7d7-4985-b3a5-6d6b6f52c203 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:21.239540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:21.240204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:21.241077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:21.241368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] PATH_INFO: `/v3/users/97af724e5b384c8a9acc4396427894da` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:21.242628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=97af724e5b384c8a9acc4396427894da)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:21.244584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:21.434536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97af724e5b384c8a9acc4396427894da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:21.441408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97af724e5b384c8a9acc4396427894da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:21.521556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97af724e5b384c8a9acc4396427894da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:21.522178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97af724e5b384c8a9acc4396427894da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:21.522779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97af724e5b384c8a9acc4396427894da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:21.543633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1017/2044] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:21 2022] DELETE /identity/v3/users/97af724e5b384c8a9acc4396427894da => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:21.548429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989bf53-5b55-45df-a41c-e8503e9a1200 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:21.548717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989bf53-5b55-45df-a41c-e8503e9a1200 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:21.548992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989bf53-5b55-45df-a41c-e8503e9a1200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:21.568076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b989bf53-5b55-45df-a41c-e8503e9a1200 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:21.570820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b989bf53-5b55-45df-a41c-e8503e9a1200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:21.629724 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1028/2045] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:21.639837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:21.641378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:21.655883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:21.701079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19998dfe-3483-430e-a5ee-b7c342be0ede admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:21.704769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac0ff8-3fc0-4993-a9e9-70d5c329b605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:21.705382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac0ff8-3fc0-4993-a9e9-70d5c329b605 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:21.705664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac0ff8-3fc0-4993-a9e9-70d5c329b605 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:21.705941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac0ff8-3fc0-4993-a9e9-70d5c329b605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:21.715027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac0ff8-3fc0-4993-a9e9-70d5c329b605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:21.716480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac0ff8-3fc0-4993-a9e9-70d5c329b605 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:21.726903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1018/2046] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:22.157350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989bf53-5b55-45df-a41c-e8503e9a1200 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:22.158843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b989bf53-5b55-45df-a41c-e8503e9a1200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:22.172007 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989bf53-5b55-45df-a41c-e8503e9a1200 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:22.176908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:22.177553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:22.177834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:22.182637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] PATH_INFO: `/v3/projects/a97cd54367e0434394e7ae5d3245ffd7` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:22.182637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97cd54367e0434394e7ae5d3245ffd7)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:22.182637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:22.278883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:22.295215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97cd54367e0434394e7ae5d3245ffd7', 'request_id': 'req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:22.301547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97cd54367e0434394e7ae5d3245ffd7', 'request_id': 'req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:22.373110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97cd54367e0434394e7ae5d3245ffd7', 'request_id': 'req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:22.384820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] The token cache is being invalidate because project a97cd54367e0434394e7ae5d3245ffd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:22.385112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:22.385745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:22.387258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1029/2047] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:22 2022] DELETE /identity/v3/projects/a97cd54367e0434394e7ae5d3245ffd7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:22.391432 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac0ff8-3fc0-4993-a9e9-70d5c329b605 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:22.402817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac0ff8-3fc0-4993-a9e9-70d5c329b605 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:22.478428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:22.479070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:22.479287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:22.479533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] PATH_INFO: `/v3/users/56bbfa5be556447699fa79e0dbe9972b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:22.480680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56bbfa5be556447699fa79e0dbe9972b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:22.482571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:22.650102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56bbfa5be556447699fa79e0dbe9972b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:22.657462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56bbfa5be556447699fa79e0dbe9972b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:22.704429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56bbfa5be556447699fa79e0dbe9972b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:22.705054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56bbfa5be556447699fa79e0dbe9972b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:22.705665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5d9f676c-113e-4790-bca9-04027a3bbdc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56bbfa5be556447699fa79e0dbe9972b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:22.724046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1019/2048] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:22 2022] DELETE /identity/v3/users/56bbfa5be556447699fa79e0dbe9972b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:23.163137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:23.164685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:23.181831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c69a69-460a-46ce-b6a6-b5eb0fa7d2af admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:23.239856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:23.241180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:23.241510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:23.241785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] PATH_INFO: `/v3/projects/75c02922f9184cd3813f3d1576d27fa7` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:23.242914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c02922f9184cd3813f3d1576d27fa7)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:23.244927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:23.357967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c02922f9184cd3813f3d1576d27fa7', 'request_id': 'req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:23.364159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c02922f9184cd3813f3d1576d27fa7', 'request_id': 'req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:23.418696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c02922f9184cd3813f3d1576d27fa7', 'request_id': 'req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:23.432128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] The token cache is being invalidate because project 75c02922f9184cd3813f3d1576d27fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:23.432264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:23.432857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-98d77fb8-faea-4e0a-b9ab-eb0b8e304203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:23.434473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1030/2049] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:23 2022] DELETE /identity/v3/projects/75c02922f9184cd3813f3d1576d27fa7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:23.439380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0415a-b0be-49d0-9b70-ecf0817b7a7a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:23.439671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0415a-b0be-49d0-9b70-ecf0817b7a7a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:23.439975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0415a-b0be-49d0-9b70-ecf0817b7a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:23.460272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c3e0415a-b0be-49d0-9b70-ecf0817b7a7a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:23.461688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c3e0415a-b0be-49d0-9b70-ecf0817b7a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:23.494419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:23.524789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1020/2050] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:23.532590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640dce5-614f-45b3-8891-5fbe15907a4d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:23.532824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640dce5-614f-45b3-8891-5fbe15907a4d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:23.533121 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640dce5-614f-45b3-8891-5fbe15907a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:23.553230 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0640dce5-614f-45b3-8891-5fbe15907a4d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:23.554427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0640dce5-614f-45b3-8891-5fbe15907a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:23.562349 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1031/2051] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:23.566510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0415a-b0be-49d0-9b70-ecf0817b7a7a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:23.576229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0415a-b0be-49d0-9b70-ecf0817b7a7a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:23.580879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e484b28-ad0b-4ced-8fcd-88749c68fa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:23.581592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e484b28-ad0b-4ced-8fcd-88749c68fa60 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:23.581878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e484b28-ad0b-4ced-8fcd-88749c68fa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:23.582152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e484b28-ad0b-4ced-8fcd-88749c68fa60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:23.587533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e484b28-ad0b-4ced-8fcd-88749c68fa60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:21:23.587533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e484b28-ad0b-4ced-8fcd-88749c68fa60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:23.587533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e484b28-ad0b-4ced-8fcd-88749c68fa60 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:23.598891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1021/2052] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:21:23.603941 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640dce5-614f-45b3-8891-5fbe15907a4d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:23.613042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640dce5-614f-45b3-8891-5fbe15907a4d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:23.617749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a0cee-d004-4ec6-a28a-964a65c2f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:23.618356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0cee-d004-4ec6-a28a-964a65c2f573 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:23.618632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0cee-d004-4ec6-a28a-964a65c2f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:23.618905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0cee-d004-4ec6-a28a-964a65c2f573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:23.619579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a0cee-d004-4ec6-a28a-964a65c2f573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:23.621702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a0cee-d004-4ec6-a28a-964a65c2f573 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:23.694368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1032/2053] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:23 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:23.699585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e484b28-ad0b-4ced-8fcd-88749c68fa60 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:23.710658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e484b28-ad0b-4ced-8fcd-88749c68fa60 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:23.776585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055ff0a-ecf9-44ff-a0a5-63ceb0ce1bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:23.777200 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055ff0a-ecf9-44ff-a0a5-63ceb0ce1bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:23.777483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055ff0a-ecf9-44ff-a0a5-63ceb0ce1bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:23.777760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055ff0a-ecf9-44ff-a0a5-63ceb0ce1bcf admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:23.778412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055ff0a-ecf9-44ff-a0a5-63ceb0ce1bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:23.780382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055ff0a-ecf9-44ff-a0a5-63ceb0ce1bcf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:23.899608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1022/2054] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:23 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:23.903510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a0cee-d004-4ec6-a28a-964a65c2f573 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:23.915943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a0cee-d004-4ec6-a28a-964a65c2f573 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:23.920598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eec8a-84e3-48f8-ba6d-b4d01e5d114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:23.921202 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eec8a-84e3-48f8-ba6d-b4d01e5d114e admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:23.921480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eec8a-84e3-48f8-ba6d-b4d01e5d114e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:23.921749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eec8a-84e3-48f8-ba6d-b4d01e5d114e admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:23.922394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eec8a-84e3-48f8-ba6d-b4d01e5d114e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:23.924014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eec8a-84e3-48f8-ba6d-b4d01e5d114e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:23.934976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1033/2055] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:23.938949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055ff0a-ecf9-44ff-a0a5-63ceb0ce1bcf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:23.950395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055ff0a-ecf9-44ff-a0a5-63ceb0ce1bcf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:23.955438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746365-7f07-4700-888c-59df4fe89ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:23.956072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746365-7f07-4700-888c-59df4fe89ced admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:23.956532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746365-7f07-4700-888c-59df4fe89ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:23.956826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746365-7f07-4700-888c-59df4fe89ced admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:23.957496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79746365-7f07-4700-888c-59df4fe89ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:23.959762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79746365-7f07-4700-888c-59df4fe89ced admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:23.971195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1023/2056] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:23.975469 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eec8a-84e3-48f8-ba6d-b4d01e5d114e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:23.985290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eec8a-84e3-48f8-ba6d-b4d01e5d114e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:23.989754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb97c56-324e-4b4c-aa44-a1d65848c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:23.990926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb97c56-324e-4b4c-aa44-a1d65848c1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:23.991193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb97c56-324e-4b4c-aa44-a1d65848c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:23.991466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb97c56-324e-4b4c-aa44-a1d65848c1f1 admin admin] PATH_INFO: `/v3/projects/0779d1baba904d6aa8f44390d0dc337c/users/cb0f609ddd7946d1a696469e2a6ae9d7/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:23.993643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:24.006939 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb97c56-324e-4b4c-aa44-a1d65848c1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0779d1baba904d6aa8f44390d0dc337c, user_id=cb0f609ddd7946d1a696469e2a6ae9d7, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:24.009616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb97c56-324e-4b4c-aa44-a1d65848c1f1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:24.081883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1034/2057] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:23 2022] PUT /identity/v3/projects/0779d1baba904d6aa8f44390d0dc337c/users/cb0f609ddd7946d1a696469e2a6ae9d7/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:24.092817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acd02e-c31c-48ae-bbfb-17547022a697 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:24.093105 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acd02e-c31c-48ae-bbfb-17547022a697 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:24.093384 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acd02e-c31c-48ae-bbfb-17547022a697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:24.122004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a5acd02e-c31c-48ae-bbfb-17547022a697 None None] MFA Rules not processed for user `cb0f609ddd7946d1a696469e2a6ae9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:24.123469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a5acd02e-c31c-48ae-bbfb-17547022a697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:24.193009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1024/2058] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:24.198081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb97c56-324e-4b4c-aa44-a1d65848c1f1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:24.260401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb97c56-324e-4b4c-aa44-a1d65848c1f1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:24.265109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae818b77-6197-430f-94d7-86189cf11de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:24.265704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae818b77-6197-430f-94d7-86189cf11de6 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:24.265983 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae818b77-6197-430f-94d7-86189cf11de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:24.266255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae818b77-6197-430f-94d7-86189cf11de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:24.266895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae818b77-6197-430f-94d7-86189cf11de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:24.268846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae818b77-6197-430f-94d7-86189cf11de6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:24.352326 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1035/2059] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:24 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:24.357510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acd02e-c31c-48ae-bbfb-17547022a697 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:24.367886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acd02e-c31c-48ae-bbfb-17547022a697 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:24.402092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:24.437253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269771-077b-40a7-b53b-6841122aa62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:24.437928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269771-077b-40a7-b53b-6841122aa62a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:24.438211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269771-077b-40a7-b53b-6841122aa62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:24.438481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269771-077b-40a7-b53b-6841122aa62a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:24.439117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83269771-077b-40a7-b53b-6841122aa62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:24.441074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83269771-077b-40a7-b53b-6841122aa62a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:24.557240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1025/2060] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:24 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:24.560857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae818b77-6197-430f-94d7-86189cf11de6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:24.571060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae818b77-6197-430f-94d7-86189cf11de6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:24.575751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa05b4-5902-4a42-a31d-8a0a01700876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:24.576409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa05b4-5902-4a42-a31d-8a0a01700876 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:24.576691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa05b4-5902-4a42-a31d-8a0a01700876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:24.576963 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa05b4-5902-4a42-a31d-8a0a01700876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:24.577740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa05b4-5902-4a42-a31d-8a0a01700876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:24.579367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa05b4-5902-4a42-a31d-8a0a01700876 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:24.590177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1036/2061] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:21:24.594375 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269771-077b-40a7-b53b-6841122aa62a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:24.606441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269771-077b-40a7-b53b-6841122aa62a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:24.611222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d44cb-e2f7-4681-9624-40ed1e786a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:24.611954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d44cb-e2f7-4681-9624-40ed1e786a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:24.612262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d44cb-e2f7-4681-9624-40ed1e786a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:24.612549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d44cb-e2f7-4681-9624-40ed1e786a2c admin admin] PATH_INFO: `/v3/projects/502ac10b3bda410c9c84e30f8e5644dc/users/0e603b6b48cd43e5be80a2b948259b91/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:24.628423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d44cb-e2f7-4681-9624-40ed1e786a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=502ac10b3bda410c9c84e30f8e5644dc, user_id=0e603b6b48cd43e5be80a2b948259b91, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:24.631132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d44cb-e2f7-4681-9624-40ed1e786a2c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:24.751456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1026/2062] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:24 2022] PUT /identity/v3/projects/502ac10b3bda410c9c84e30f8e5644dc/users/0e603b6b48cd43e5be80a2b948259b91/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:24.755436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa05b4-5902-4a42-a31d-8a0a01700876 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:24.767788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa05b4-5902-4a42-a31d-8a0a01700876 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:24.846986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3a884-5bbf-44ff-b261-ccacad9d7d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:24.847508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a884-5bbf-44ff-b261-ccacad9d7d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:24.847952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a884-5bbf-44ff-b261-ccacad9d7d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:24.848298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a884-5bbf-44ff-b261-ccacad9d7d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:24.851155 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a884-5bbf-44ff-b261-ccacad9d7d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:24.851487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a884-5bbf-44ff-b261-ccacad9d7d8a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:24.866630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1037/2063] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:24.867926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d44cb-e2f7-4681-9624-40ed1e786a2c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:24.879780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d44cb-e2f7-4681-9624-40ed1e786a2c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:24.885033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29872-cd6f-40fe-b73e-58ae22d1e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:24.885948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29872-cd6f-40fe-b73e-58ae22d1e89c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:24.886077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29872-cd6f-40fe-b73e-58ae22d1e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:24.886356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29872-cd6f-40fe-b73e-58ae22d1e89c admin admin] PATH_INFO: `/v3/projects/502ac10b3bda410c9c84e30f8e5644dc/users/0e603b6b48cd43e5be80a2b948259b91/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:24.888444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b29872-cd6f-40fe-b73e-58ae22d1e89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=502ac10b3bda410c9c84e30f8e5644dc, user_id=0e603b6b48cd43e5be80a2b948259b91, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:24.891619 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b29872-cd6f-40fe-b73e-58ae22d1e89c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:24.907037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1027/2064] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:24 2022] PUT /identity/v3/projects/502ac10b3bda410c9c84e30f8e5644dc/users/0e603b6b48cd43e5be80a2b948259b91/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:24.919719 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b67cc5-d78b-4e07-9539-7b3eb4cbec17 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:24.920004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b67cc5-d78b-4e07-9539-7b3eb4cbec17 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:24.920341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b67cc5-d78b-4e07-9539-7b3eb4cbec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:24.948431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-01b67cc5-d78b-4e07-9539-7b3eb4cbec17 None None] MFA Rules not processed for user `0e603b6b48cd43e5be80a2b948259b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:24.949639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-01b67cc5-d78b-4e07-9539-7b3eb4cbec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:25.001686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:25.029422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1038/2065] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:25.042251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29872-cd6f-40fe-b73e-58ae22d1e89c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:25.043953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f4b29872-cd6f-40fe-b73e-58ae22d1e89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:25.105303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29872-cd6f-40fe-b73e-58ae22d1e89c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:25.109160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682722a-777c-4dd5-a25f-404593fe48e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:25.109774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682722a-777c-4dd5-a25f-404593fe48e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:25.110056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682722a-777c-4dd5-a25f-404593fe48e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:25.110332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682722a-777c-4dd5-a25f-404593fe48e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:25.121088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682722a-777c-4dd5-a25f-404593fe48e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:25.134678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682722a-777c-4dd5-a25f-404593fe48e0 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:25.134678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1028/2066] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:26.020958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b67cc5-d78b-4e07-9539-7b3eb4cbec17 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:26.032487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b67cc5-d78b-4e07-9539-7b3eb4cbec17 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:26.037352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026afe-e2f4-4392-8bc0-5f3c063c2577 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e603b6b48cd43e5be80a2b948259b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '502ac10b3bda410c9c84e30f8e5644dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:26.037980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026afe-e2f4-4392-8bc0-5f3c063c2577 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:26.038308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026afe-e2f4-4392-8bc0-5f3c063c2577 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:26.038589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026afe-e2f4-4392-8bc0-5f3c063c2577 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:26.039253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026afe-e2f4-4392-8bc0-5f3c063c2577 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:21:26.039652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026afe-e2f4-4392-8bc0-5f3c063c2577 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:26.041168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026afe-e2f4-4392-8bc0-5f3c063c2577 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:26.054906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1039/2067] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:21:26.060722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682722a-777c-4dd5-a25f-404593fe48e0 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:26.071495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682722a-777c-4dd5-a25f-404593fe48e0 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:26.076674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c29b0-3a89-4f72-bc3b-1e6c69e8683a tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e603b6b48cd43e5be80a2b948259b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '502ac10b3bda410c9c84e30f8e5644dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:26.076871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c29b0-3a89-4f72-bc3b-1e6c69e8683a tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:26.077148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c29b0-3a89-4f72-bc3b-1e6c69e8683a tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:26.077428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c29b0-3a89-4f72-bc3b-1e6c69e8683a tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:26.078065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c29b0-3a89-4f72-bc3b-1e6c69e8683a tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:26.080046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c29b0-3a89-4f72-bc3b-1e6c69e8683a tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:26.169818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1029/2068] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:26 2022] POST /identity/v3/projects => generated 354 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:26.174126 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026afe-e2f4-4392-8bc0-5f3c063c2577 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:26.184752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026afe-e2f4-4392-8bc0-5f3c063c2577 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:26.242533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a3ed8-6234-4af7-bf9d-1480376ea203 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e603b6b48cd43e5be80a2b948259b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '502ac10b3bda410c9c84e30f8e5644dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:26.243072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a3ed8-6234-4af7-bf9d-1480376ea203 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:26.243349 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a3ed8-6234-4af7-bf9d-1480376ea203 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:26.243625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a3ed8-6234-4af7-bf9d-1480376ea203 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:26.244447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a3ed8-6234-4af7-bf9d-1480376ea203 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:21:26.244754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a3ed8-6234-4af7-bf9d-1480376ea203 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:26.246424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a3ed8-6234-4af7-bf9d-1480376ea203 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:26.262282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1040/2069] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:21:26.299170 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c29b0-3a89-4f72-bc3b-1e6c69e8683a tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:26.310190 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c29b0-3a89-4f72-bc3b-1e6c69e8683a tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:26.314826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e603b6b48cd43e5be80a2b948259b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '502ac10b3bda410c9c84e30f8e5644dc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:26.315466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:26.315745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:26.316023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] PATH_INFO: `/v3/projects/40184f75d35c432fa570283b2de4a782` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:26.317183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: Authorizing `identity:delete_project(project_id=40184f75d35c432fa570283b2de4a782)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:26.319094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:26.425806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40184f75d35c432fa570283b2de4a782', 'request_id': 'req-ead10db7-ed7e-4d98-89b1-673859bc24f2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:26.433759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40184f75d35c432fa570283b2de4a782', 'request_id': 'req-ead10db7-ed7e-4d98-89b1-673859bc24f2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:26.438011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:26.440438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40184f75d35c432fa570283b2de4a782', 'request_id': 'req-ead10db7-ed7e-4d98-89b1-673859bc24f2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:26.533150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] The token cache is being invalidate because project 40184f75d35c432fa570283b2de4a782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:26.533567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:26.534360 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ead10db7-ed7e-4d98-89b1-673859bc24f2 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:26.536348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1030/2070] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:26 2022] DELETE /identity/v3/projects/40184f75d35c432fa570283b2de4a782 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:27.146831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a3ed8-6234-4af7-bf9d-1480376ea203 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:27.148757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-380a3ed8-6234-4af7-bf9d-1480376ea203 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:27.223446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a3ed8-6234-4af7-bf9d-1480376ea203 tempest-VolumeQuotaClassesTest-1221600438 tempest-VolumeQuotaClassesTest-1221600438-project-admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:27.284628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:27.285294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:27.285604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:27.285889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] PATH_INFO: `/v3/users/cb0f609ddd7946d1a696469e2a6ae9d7` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:27.287110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0f609ddd7946d1a696469e2a6ae9d7)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:27.289226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:27.295148 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:27.473166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0f609ddd7946d1a696469e2a6ae9d7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:27.481556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0f609ddd7946d1a696469e2a6ae9d7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:27.482423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0f609ddd7946d1a696469e2a6ae9d7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:27.538747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0f609ddd7946d1a696469e2a6ae9d7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:27.552816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0f609ddd7946d1a696469e2a6ae9d7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:27.559507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1041/2071] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:27 2022] DELETE /identity/v3/users/cb0f609ddd7946d1a696469e2a6ae9d7 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:27.564309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15150e5f-120e-49f6-ba1b-75cb6f50c60e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:27.564948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15150e5f-120e-49f6-ba1b-75cb6f50c60e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:27.564948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15150e5f-120e-49f6-ba1b-75cb6f50c60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:27.584426 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-15150e5f-120e-49f6-ba1b-75cb6f50c60e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:27.585627 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15150e5f-120e-49f6-ba1b-75cb6f50c60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:27.644774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1031/2072] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:21:27.655927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:27.657591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:27.718167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff781-32d1-4c11-874f-d3dd5484c793 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:27.723569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5a500-213f-40ac-8775-e492407199e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:27.723569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5a500-213f-40ac-8775-e492407199e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:27.723569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5a500-213f-40ac-8775-e492407199e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:27.723569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5a500-213f-40ac-8775-e492407199e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:27.734163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5a500-213f-40ac-8775-e492407199e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:27.735589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5a500-213f-40ac-8775-e492407199e7 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:27.745000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1042/2073] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:28.294847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15150e5f-120e-49f6-ba1b-75cb6f50c60e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:28.303044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15150e5f-120e-49f6-ba1b-75cb6f50c60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:28.314353 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15150e5f-120e-49f6-ba1b-75cb6f50c60e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:28.320465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:28.321788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:28.322076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:28.322353 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] PATH_INFO: `/v3/projects/0779d1baba904d6aa8f44390d0dc337c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:28.323495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0779d1baba904d6aa8f44390d0dc337c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:28.325495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:28.467300 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0779d1baba904d6aa8f44390d0dc337c', 'request_id': 'req-6e4e125c-d608-4946-b7c8-703deaf9a177'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:28.473915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0779d1baba904d6aa8f44390d0dc337c', 'request_id': 'req-6e4e125c-d608-4946-b7c8-703deaf9a177'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:28.480255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0779d1baba904d6aa8f44390d0dc337c', 'request_id': 'req-6e4e125c-d608-4946-b7c8-703deaf9a177'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:28.539166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] The token cache is being invalidate because project 0779d1baba904d6aa8f44390d0dc337c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:28.539508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:28.540115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:28.541737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1032/2074] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:28 2022] DELETE /identity/v3/projects/0779d1baba904d6aa8f44390d0dc337c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:28.545936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5a500-213f-40ac-8775-e492407199e7 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:28.556110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5a500-213f-40ac-8775-e492407199e7 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:28.613796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:28.614429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:28.614709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:28.614981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] PATH_INFO: `/v3/users/0e603b6b48cd43e5be80a2b948259b91` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:28.616095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e603b6b48cd43e5be80a2b948259b91)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:28.618558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:28.768876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:28.782758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e603b6b48cd43e5be80a2b948259b91'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:28.789380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e603b6b48cd43e5be80a2b948259b91'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:28.790035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e603b6b48cd43e5be80a2b948259b91'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:28.864860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e603b6b48cd43e5be80a2b948259b91'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:28.878715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-88e38c60-f2b0-4498-b3ee-cfb98125a37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e603b6b48cd43e5be80a2b948259b91'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:28.885955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1043/2075] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:28 2022] DELETE /identity/v3/users/0e603b6b48cd43e5be80a2b948259b91 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:29.283503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:29.285290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:29.301240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e125c-d608-4946-b7c8-703deaf9a177 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:29.363019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:29.365252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:29.365252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:29.365252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] PATH_INFO: `/v3/projects/502ac10b3bda410c9c84e30f8e5644dc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:29.365543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] RBAC: Authorizing `identity:delete_project(project_id=502ac10b3bda410c9c84e30f8e5644dc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:29.367437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:29.380435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:29.495564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502ac10b3bda410c9c84e30f8e5644dc', 'request_id': 'req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:29.502303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502ac10b3bda410c9c84e30f8e5644dc', 'request_id': 'req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:29.509445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502ac10b3bda410c9c84e30f8e5644dc', 'request_id': 'req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:29.612915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] The token cache is being invalidate because project 502ac10b3bda410c9c84e30f8e5644dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:29.613214 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:29.613882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9369fef3-aa51-4c89-b7e1-ac1e0fe6587c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:29.615405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1033/2076] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:29 2022] DELETE /identity/v3/projects/502ac10b3bda410c9c84e30f8e5644dc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:29.625630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564be54-63b9-4e2b-ba9f-ac2f50be3e38 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:29.625630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564be54-63b9-4e2b-ba9f-ac2f50be3e38 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:29.625630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564be54-63b9-4e2b-ba9f-ac2f50be3e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:29.645014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6564be54-63b9-4e2b-ba9f-ac2f50be3e38 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:29.646390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6564be54-63b9-4e2b-ba9f-ac2f50be3e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:29.716888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1044/2077] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:21:29.730384 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94b9e-f143-4f50-b6c2-c1e80ab63f36 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:29.730637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94b9e-f143-4f50-b6c2-c1e80ab63f36 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:29.730950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94b9e-f143-4f50-b6c2-c1e80ab63f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:29.751806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0ed94b9e-f143-4f50-b6c2-c1e80ab63f36 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:29.753053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0ed94b9e-f143-4f50-b6c2-c1e80ab63f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:29.761211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1034/2078] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:29.765479 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564be54-63b9-4e2b-ba9f-ac2f50be3e38 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:29.775624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564be54-63b9-4e2b-ba9f-ac2f50be3e38 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:29.780362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86740e91-a1c2-46ca-a6d0-cd94854b760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:29.780967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86740e91-a1c2-46ca-a6d0-cd94854b760e admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:29.781244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86740e91-a1c2-46ca-a6d0-cd94854b760e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:29.781537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86740e91-a1c2-46ca-a6d0-cd94854b760e admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:29.782183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86740e91-a1c2-46ca-a6d0-cd94854b760e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:21:29.782486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86740e91-a1c2-46ca-a6d0-cd94854b760e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:29.784073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86740e91-a1c2-46ca-a6d0-cd94854b760e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:29.796471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1045/2079] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:21:29.801903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94b9e-f143-4f50-b6c2-c1e80ab63f36 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:29.812189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94b9e-f143-4f50-b6c2-c1e80ab63f36 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:29.817067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec213cb-0c68-472d-843c-150e461a7f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:29.817671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec213cb-0c68-472d-843c-150e461a7f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:29.817952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec213cb-0c68-472d-843c-150e461a7f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:29.818232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec213cb-0c68-472d-843c-150e461a7f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:29.818869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec213cb-0c68-472d-843c-150e461a7f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:29.820860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec213cb-0c68-472d-843c-150e461a7f92 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:29.947613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1035/2080] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:29 2022] POST /identity/v3/projects => generated 361 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:29.951762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86740e91-a1c2-46ca-a6d0-cd94854b760e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:29.962345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86740e91-a1c2-46ca-a6d0-cd94854b760e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:30.017696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344cc60-4862-4ebc-a0b8-98cbcda56680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:30.018300 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344cc60-4862-4ebc-a0b8-98cbcda56680 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:30.018578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344cc60-4862-4ebc-a0b8-98cbcda56680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:30.018849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344cc60-4862-4ebc-a0b8-98cbcda56680 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:30.019484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344cc60-4862-4ebc-a0b8-98cbcda56680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:30.021414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344cc60-4862-4ebc-a0b8-98cbcda56680 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:30.105103 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1046/2081] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:29 2022] POST /identity/v3/users => generated 281 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:21:30.109189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec213cb-0c68-472d-843c-150e461a7f92 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:30.119630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec213cb-0c68-472d-843c-150e461a7f92 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:30.124620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a7c06-0665-48d6-adde-893020d4c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:30.125220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a7c06-0665-48d6-adde-893020d4c71b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:30.125554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a7c06-0665-48d6-adde-893020d4c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:30.125828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a7c06-0665-48d6-adde-893020d4c71b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:30.126478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a7c06-0665-48d6-adde-893020d4c71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:30.128072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a7c06-0665-48d6-adde-893020d4c71b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:30.138187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1036/2082] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:30.142275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344cc60-4862-4ebc-a0b8-98cbcda56680 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:30.154699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344cc60-4862-4ebc-a0b8-98cbcda56680 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:30.159582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf072-5d05-4802-b71e-da835e1e2034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:30.160200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf072-5d05-4802-b71e-da835e1e2034 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:30.161390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf072-5d05-4802-b71e-da835e1e2034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:30.161390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf072-5d05-4802-b71e-da835e1e2034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:30.161639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf072-5d05-4802-b71e-da835e1e2034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:30.163404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf072-5d05-4802-b71e-da835e1e2034 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:30.175763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1047/2083] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:30.180021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a7c06-0665-48d6-adde-893020d4c71b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:30.190604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a7c06-0665-48d6-adde-893020d4c71b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:30.195354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ba6a8-9644-4fad-be27-116df9fda369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:30.196062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba6a8-9644-4fad-be27-116df9fda369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:30.196390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba6a8-9644-4fad-be27-116df9fda369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:30.196695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba6a8-9644-4fad-be27-116df9fda369 admin admin] PATH_INFO: `/v3/projects/a0fe884c5594476da9502118eb28ceb5/users/5f595e5fab62465bb4ef94f451bda2b0/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:30.212065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ba6a8-9644-4fad-be27-116df9fda369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0fe884c5594476da9502118eb28ceb5, user_id=5f595e5fab62465bb4ef94f451bda2b0, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:30.214735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ba6a8-9644-4fad-be27-116df9fda369 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:30.316147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1037/2084] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:30 2022] PUT /identity/v3/projects/a0fe884c5594476da9502118eb28ceb5/users/5f595e5fab62465bb4ef94f451bda2b0/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:30.328274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4818-4ea8-4ae7-aa34-8c08907eee3f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:30.328537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4818-4ea8-4ae7-aa34-8c08907eee3f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:30.328820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4818-4ea8-4ae7-aa34-8c08907eee3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:30.354434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:30.357505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3d7c4818-4ea8-4ae7-aa34-8c08907eee3f None None] MFA Rules not processed for user `5f595e5fab62465bb4ef94f451bda2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:30.358720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3d7c4818-4ea8-4ae7-aa34-8c08907eee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:30.422190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1048/2085] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:30.464966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ba6a8-9644-4fad-be27-116df9fda369 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:30.466589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-615ba6a8-9644-4fad-be27-116df9fda369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:30.526671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ba6a8-9644-4fad-be27-116df9fda369 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:30.530459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b9152-7350-4e12-9987-b10c4c9ea5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:30.531099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b9152-7350-4e12-9987-b10c4c9ea5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:30.531376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b9152-7350-4e12-9987-b10c4c9ea5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:30.531649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b9152-7350-4e12-9987-b10c4c9ea5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:30.540858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b9152-7350-4e12-9987-b10c4c9ea5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:30.542332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b9152-7350-4e12-9987-b10c4c9ea5f4 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:30.551539 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1038/2086] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:30.567220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c4818-4ea8-4ae7-aa34-8c08907eee3f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:30.632572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c4818-4ea8-4ae7-aa34-8c08907eee3f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:30.637951 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:30.638613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:30.638898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:30.639202 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] PATH_INFO: `/v3/users/5f595e5fab62465bb4ef94f451bda2b0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:30.640383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f595e5fab62465bb4ef94f451bda2b0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:30.642290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:30.816021 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f595e5fab62465bb4ef94f451bda2b0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:30.825678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f595e5fab62465bb4ef94f451bda2b0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:30.826402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f595e5fab62465bb4ef94f451bda2b0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:30.927195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f595e5fab62465bb4ef94f451bda2b0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:30.940654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f595e5fab62465bb4ef94f451bda2b0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:30.947239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1049/2087] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:30 2022] DELETE /identity/v3/users/5f595e5fab62465bb4ef94f451bda2b0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:30.951693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a798c4-88c6-4a56-8f2d-da8deedf08e6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:30.951983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a798c4-88c6-4a56-8f2d-da8deedf08e6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:30.952290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a798c4-88c6-4a56-8f2d-da8deedf08e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:30.971742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-52a798c4-88c6-4a56-8f2d-da8deedf08e6 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:30.973004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52a798c4-88c6-4a56-8f2d-da8deedf08e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:31.009805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:31.034965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1039/2088] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:31.045910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:31.047348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:31.073925 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:31.104746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552cdc2-1a1c-432e-9757-6e392564aee5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:31.108867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a89bb-bd0c-4403-b028-4582bc318c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:31.109461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a89bb-bd0c-4403-b028-4582bc318c0a service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:31.109739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a89bb-bd0c-4403-b028-4582bc318c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:31.110011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a89bb-bd0c-4403-b028-4582bc318c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:31.119472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a89bb-bd0c-4403-b028-4582bc318c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:31.120965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a89bb-bd0c-4403-b028-4582bc318c0a service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:31.130639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1050/2089] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:31.585833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a798c4-88c6-4a56-8f2d-da8deedf08e6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:31.587786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52a798c4-88c6-4a56-8f2d-da8deedf08e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:31.602725 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a798c4-88c6-4a56-8f2d-da8deedf08e6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:31.607773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:31.608450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:31.608730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:31.609002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] PATH_INFO: `/v3/projects/a0fe884c5594476da9502118eb28ceb5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:31.610135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0fe884c5594476da9502118eb28ceb5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:31.612072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:31.766662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0fe884c5594476da9502118eb28ceb5', 'request_id': 'req-15c23b18-1410-472b-b630-8d6669a12aec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:31.773066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0fe884c5594476da9502118eb28ceb5', 'request_id': 'req-15c23b18-1410-472b-b630-8d6669a12aec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:31.779704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0fe884c5594476da9502118eb28ceb5', 'request_id': 'req-15c23b18-1410-472b-b630-8d6669a12aec'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:31.852876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] The token cache is being invalidate because project a0fe884c5594476da9502118eb28ceb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:31.853080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:31.853697 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-15c23b18-1410-472b-b630-8d6669a12aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:31.855252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1040/2090] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:31 2022] DELETE /identity/v3/projects/a0fe884c5594476da9502118eb28ceb5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:31.860233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dab419-bc84-405a-b040-4359410da51f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:31.860711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dab419-bc84-405a-b040-4359410da51f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:31.860814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dab419-bc84-405a-b040-4359410da51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:31.881137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-22dab419-bc84-405a-b040-4359410da51f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:31.882335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-22dab419-bc84-405a-b040-4359410da51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:31.944925 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1051/2091] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:31.952985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e570b3-0e6b-47a7-b7c8-afb8fd370e0a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:31.953271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e570b3-0e6b-47a7-b7c8-afb8fd370e0a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:31.953549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e570b3-0e6b-47a7-b7c8-afb8fd370e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:31.973972 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d0e570b3-0e6b-47a7-b7c8-afb8fd370e0a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:31.975178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d0e570b3-0e6b-47a7-b7c8-afb8fd370e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:31.983346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1041/2092] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:31.987491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dab419-bc84-405a-b040-4359410da51f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:31.997043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dab419-bc84-405a-b040-4359410da51f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:32.001850 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8ed7c-422e-46ef-b40e-09009c48e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:32.002455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8ed7c-422e-46ef-b40e-09009c48e297 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:32.002736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8ed7c-422e-46ef-b40e-09009c48e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:32.003009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8ed7c-422e-46ef-b40e-09009c48e297 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:32.003683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8ed7c-422e-46ef-b40e-09009c48e297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:21:32.004005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8ed7c-422e-46ef-b40e-09009c48e297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:32.005682 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8ed7c-422e-46ef-b40e-09009c48e297 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:32.017950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1052/2093] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:21:32.022223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e570b3-0e6b-47a7-b7c8-afb8fd370e0a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:32.032183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e570b3-0e6b-47a7-b7c8-afb8fd370e0a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:32.037736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c6f07-b97b-46fe-b296-124c449928a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:32.038341 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c6f07-b97b-46fe-b296-124c449928a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:32.038615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c6f07-b97b-46fe-b296-124c449928a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:32.038912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c6f07-b97b-46fe-b296-124c449928a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:32.039552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c6f07-b97b-46fe-b296-124c449928a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:32.041466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c6f07-b97b-46fe-b296-124c449928a8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:32.157263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1042/2094] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:32 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:32.161540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8ed7c-422e-46ef-b40e-09009c48e297 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:32.171502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8ed7c-422e-46ef-b40e-09009c48e297 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:32.230318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241ecb8-5557-49ca-b90f-743d5d812830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:32.230918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241ecb8-5557-49ca-b90f-743d5d812830 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:32.231195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241ecb8-5557-49ca-b90f-743d5d812830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:32.231463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241ecb8-5557-49ca-b90f-743d5d812830 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:32.232098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241ecb8-5557-49ca-b90f-743d5d812830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:32.234042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241ecb8-5557-49ca-b90f-743d5d812830 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:32.350406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1053/2095] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:32 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:32.354424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c6f07-b97b-46fe-b296-124c449928a8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:32.368174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c6f07-b97b-46fe-b296-124c449928a8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:32.374113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b90b31-1283-45cd-b80c-13d314be10aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:32.374739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b90b31-1283-45cd-b80c-13d314be10aa admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:32.375019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b90b31-1283-45cd-b80c-13d314be10aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:32.375297 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b90b31-1283-45cd-b80c-13d314be10aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:32.376260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b90b31-1283-45cd-b80c-13d314be10aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:32.378108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b90b31-1283-45cd-b80c-13d314be10aa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:32.390504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1043/2096] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:32.394410 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241ecb8-5557-49ca-b90f-743d5d812830 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:32.406258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241ecb8-5557-49ca-b90f-743d5d812830 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:32.409774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ec6cc-5354-4f9b-a9fc-d24eb98d131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:32.410400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec6cc-5354-4f9b-a9fc-d24eb98d131b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:32.410683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec6cc-5354-4f9b-a9fc-d24eb98d131b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:32.410966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec6cc-5354-4f9b-a9fc-d24eb98d131b admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:32.411727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ec6cc-5354-4f9b-a9fc-d24eb98d131b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:32.413459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ec6cc-5354-4f9b-a9fc-d24eb98d131b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:32.431590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1054/2097] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:21:32.436536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b90b31-1283-45cd-b80c-13d314be10aa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:32.448956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b90b31-1283-45cd-b80c-13d314be10aa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:32.453986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53197b-a0d8-4106-a5e6-14e1b566db2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:32.454661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53197b-a0d8-4106-a5e6-14e1b566db2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:32.455045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53197b-a0d8-4106-a5e6-14e1b566db2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:32.455335 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53197b-a0d8-4106-a5e6-14e1b566db2d admin admin] PATH_INFO: `/v3/projects/b6f5f08a6acb44d389d989fd5c145861/users/214310d8b4a44a1cabd09b2a7b642ac1/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:32.471747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53197b-a0d8-4106-a5e6-14e1b566db2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f5f08a6acb44d389d989fd5c145861, user_id=214310d8b4a44a1cabd09b2a7b642ac1, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:32.474484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53197b-a0d8-4106-a5e6-14e1b566db2d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:32.545733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1044/2098] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:32 2022] PUT /identity/v3/projects/b6f5f08a6acb44d389d989fd5c145861/users/214310d8b4a44a1cabd09b2a7b642ac1/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:32.556846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047706cf-a7e5-49dd-abcb-c372da2fe5d4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:32.557152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047706cf-a7e5-49dd-abcb-c372da2fe5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:32.557437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047706cf-a7e5-49dd-abcb-c372da2fe5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:32.586406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-047706cf-a7e5-49dd-abcb-c372da2fe5d4 None None] MFA Rules not processed for user `214310d8b4a44a1cabd09b2a7b642ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:32.587696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-047706cf-a7e5-49dd-abcb-c372da2fe5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:32.607047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:32.656363 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1055/2099] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:32.661055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53197b-a0d8-4106-a5e6-14e1b566db2d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:32.722917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53197b-a0d8-4106-a5e6-14e1b566db2d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:32.727685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed016a-c619-44a6-871b-267a73155ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:32.728796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed016a-c619-44a6-871b-267a73155ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:32.729076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed016a-c619-44a6-871b-267a73155ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:32.729350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed016a-c619-44a6-871b-267a73155ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:32.729983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed016a-c619-44a6-871b-267a73155ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:32.731877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed016a-c619-44a6-871b-267a73155ea8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:32.736347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:32.822419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1045/2100] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:32 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:32.823565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047706cf-a7e5-49dd-abcb-c372da2fe5d4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:32.834545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047706cf-a7e5-49dd-abcb-c372da2fe5d4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:32.889954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae84ca8-a3f3-4c02-9ad5-1497016fb42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:32.890631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae84ca8-a3f3-4c02-9ad5-1497016fb42a admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:32.890830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae84ca8-a3f3-4c02-9ad5-1497016fb42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:32.891104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae84ca8-a3f3-4c02-9ad5-1497016fb42a admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:32.891744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae84ca8-a3f3-4c02-9ad5-1497016fb42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:32.893678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae84ca8-a3f3-4c02-9ad5-1497016fb42a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:33.010616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1056/2101] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:32 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:33.011970 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed016a-c619-44a6-871b-267a73155ea8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:33.022675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed016a-c619-44a6-871b-267a73155ea8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:33.027780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c3f34-e91b-4bfa-803b-e327ad11ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:33.028407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c3f34-e91b-4bfa-803b-e327ad11ac9a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:33.028861 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c3f34-e91b-4bfa-803b-e327ad11ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:33.029134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c3f34-e91b-4bfa-803b-e327ad11ac9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:33.034217 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c3f34-e91b-4bfa-803b-e327ad11ac9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:33.034217 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c3f34-e91b-4bfa-803b-e327ad11ac9a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:33.042121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1046/2102] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:33.046582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae84ca8-a3f3-4c02-9ad5-1497016fb42a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:33.057293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae84ca8-a3f3-4c02-9ad5-1497016fb42a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:33.062244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5470e-8e09-46ab-a30b-c0111db570ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:33.063027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5470e-8e09-46ab-a30b-c0111db570ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:33.063367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5470e-8e09-46ab-a30b-c0111db570ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:33.063653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5470e-8e09-46ab-a30b-c0111db570ca admin admin] PATH_INFO: `/v3/projects/921b9d4511ff460d89b35ff72717b0a1/users/2b86a5aa9ef64884bb12063078c33ddc/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:33.088509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5470e-8e09-46ab-a30b-c0111db570ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=921b9d4511ff460d89b35ff72717b0a1, user_id=2b86a5aa9ef64884bb12063078c33ddc, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:33.088509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5470e-8e09-46ab-a30b-c0111db570ca admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:33.162118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1057/2103] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:33 2022] PUT /identity/v3/projects/921b9d4511ff460d89b35ff72717b0a1/users/2b86a5aa9ef64884bb12063078c33ddc/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:21:33.166791 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c3f34-e91b-4bfa-803b-e327ad11ac9a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:33.177954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c3f34-e91b-4bfa-803b-e327ad11ac9a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:33.238242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef05ccd-e655-4d54-a71d-59c8fb60b2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:33.238780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef05ccd-e655-4d54-a71d-59c8fb60b2ea admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:33.239058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef05ccd-e655-4d54-a71d-59c8fb60b2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:33.239328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef05ccd-e655-4d54-a71d-59c8fb60b2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:33.239973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef05ccd-e655-4d54-a71d-59c8fb60b2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:33.241595 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef05ccd-e655-4d54-a71d-59c8fb60b2ea admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:33.251424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1047/2104] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:33.255742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5470e-8e09-46ab-a30b-c0111db570ca admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:33.265993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5470e-8e09-46ab-a30b-c0111db570ca admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:33.270568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9034d9-9015-4862-9463-bf44a2bdced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:33.271219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9034d9-9015-4862-9463-bf44a2bdced4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:33.271496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9034d9-9015-4862-9463-bf44a2bdced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:33.271770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9034d9-9015-4862-9463-bf44a2bdced4 admin admin] PATH_INFO: `/v3/projects/921b9d4511ff460d89b35ff72717b0a1/users/2b86a5aa9ef64884bb12063078c33ddc/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:33.273686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9034d9-9015-4862-9463-bf44a2bdced4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=921b9d4511ff460d89b35ff72717b0a1, user_id=2b86a5aa9ef64884bb12063078c33ddc, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:33.276847 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9034d9-9015-4862-9463-bf44a2bdced4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:33.287382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1058/2105] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:33 2022] PUT /identity/v3/projects/921b9d4511ff460d89b35ff72717b0a1/users/2b86a5aa9ef64884bb12063078c33ddc/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:33.299240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822923-eb7e-45f7-9a03-59f7f82aae10 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:33.299618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822923-eb7e-45f7-9a03-59f7f82aae10 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:33.299967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822923-eb7e-45f7-9a03-59f7f82aae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:33.329349 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-55822923-eb7e-45f7-9a03-59f7f82aae10 None None] MFA Rules not processed for user `2b86a5aa9ef64884bb12063078c33ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:33.330593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-55822923-eb7e-45f7-9a03-59f7f82aae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:33.401521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1048/2106] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:33.412544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9034d9-9015-4862-9463-bf44a2bdced4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:33.414240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fa9034d9-9015-4862-9463-bf44a2bdced4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:33.473434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9034d9-9015-4862-9463-bf44a2bdced4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:33.477086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4a5e7-fe12-4088-8426-93119885f67d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:33.477692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4a5e7-fe12-4088-8426-93119885f67d service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:33.477971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4a5e7-fe12-4088-8426-93119885f67d service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:33.478243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4a5e7-fe12-4088-8426-93119885f67d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:33.503886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:33.533576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4a5e7-fe12-4088-8426-93119885f67d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:33.535015 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4a5e7-fe12-4088-8426-93119885f67d service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:33.544540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1059/2107] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:37.710427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55822923-eb7e-45f7-9a03-59f7f82aae10 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:37.771658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:37.778596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55822923-eb7e-45f7-9a03-59f7f82aae10 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:37.783077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:37.783747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:37.784312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:37.784590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] PATH_INFO: `/v3/users/214310d8b4a44a1cabd09b2a7b642ac1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:37.785700 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214310d8b4a44a1cabd09b2a7b642ac1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:37.787642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:37.946488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214310d8b4a44a1cabd09b2a7b642ac1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:37.953674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214310d8b4a44a1cabd09b2a7b642ac1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:38.012804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214310d8b4a44a1cabd09b2a7b642ac1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:38.013520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214310d8b4a44a1cabd09b2a7b642ac1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:38.014227 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214310d8b4a44a1cabd09b2a7b642ac1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:38.034917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1049/2108] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:37 2022] DELETE /identity/v3/users/214310d8b4a44a1cabd09b2a7b642ac1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:38.039669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfca983-1208-4b5f-9f30-cecd3157bce6 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:38.040142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfca983-1208-4b5f-9f30-cecd3157bce6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:38.040330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfca983-1208-4b5f-9f30-cecd3157bce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:38.059179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9cfca983-1208-4b5f-9f30-cecd3157bce6 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:38.060426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9cfca983-1208-4b5f-9f30-cecd3157bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:38.135748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1060/2109] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:38.148405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:38.150539 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:38.210837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f9485-6a84-425b-959e-989b25d6d368 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:38.214495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec12ce7-6bb5-4b6f-a27a-04e86da067bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:38.215103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec12ce7-6bb5-4b6f-a27a-04e86da067bb service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:38.215385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec12ce7-6bb5-4b6f-a27a-04e86da067bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:38.215668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec12ce7-6bb5-4b6f-a27a-04e86da067bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:38.224727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec12ce7-6bb5-4b6f-a27a-04e86da067bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:38.226167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec12ce7-6bb5-4b6f-a27a-04e86da067bb service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:38.237955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1050/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:38.676923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfca983-1208-4b5f-9f30-cecd3157bce6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:38.678493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9cfca983-1208-4b5f-9f30-cecd3157bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:38.700064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfca983-1208-4b5f-9f30-cecd3157bce6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:38.705957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:38.706624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:38.706963 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:38.707154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] PATH_INFO: `/v3/projects/b6f5f08a6acb44d389d989fd5c145861` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:38.708330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f5f08a6acb44d389d989fd5c145861)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:38.710771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:38.813372 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f5f08a6acb44d389d989fd5c145861', 'request_id': 'req-71cd8c36-1bab-46bb-9469-af7c0f810e19'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:38.819660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f5f08a6acb44d389d989fd5c145861', 'request_id': 'req-71cd8c36-1bab-46bb-9469-af7c0f810e19'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:38.887556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f5f08a6acb44d389d989fd5c145861', 'request_id': 'req-71cd8c36-1bab-46bb-9469-af7c0f810e19'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:38.898993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] The token cache is being invalidate because project b6f5f08a6acb44d389d989fd5c145861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:38.899285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:38.900581 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:38.902128 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1061/2111] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:38 2022] DELETE /identity/v3/projects/b6f5f08a6acb44d389d989fd5c145861 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:38.906344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec12ce7-6bb5-4b6f-a27a-04e86da067bb service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:38.916456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec12ce7-6bb5-4b6f-a27a-04e86da067bb service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:38.973477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:38.974107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:38.974395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:38.974670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] PATH_INFO: `/v3/users/2b86a5aa9ef64884bb12063078c33ddc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:38.975812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b86a5aa9ef64884bb12063078c33ddc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:38.977812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:39.004034 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:39.212527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b86a5aa9ef64884bb12063078c33ddc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:39.219464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b86a5aa9ef64884bb12063078c33ddc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:39.379148 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b86a5aa9ef64884bb12063078c33ddc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:39.379747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b86a5aa9ef64884bb12063078c33ddc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:39.387956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-70c69dd1-bc92-4537-81a7-8972038b3012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b86a5aa9ef64884bb12063078c33ddc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:39.398686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1051/2112] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:38 2022] DELETE /identity/v3/users/2b86a5aa9ef64884bb12063078c33ddc => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:40.101517 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:40.107718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:40.126198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd8c36-1bab-46bb-9469-af7c0f810e19 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:40.174494 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:40.184197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:40.184777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:40.185055 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:40.185326 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] PATH_INFO: `/v3/projects/921b9d4511ff460d89b35ff72717b0a1` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:40.186457 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=921b9d4511ff460d89b35ff72717b0a1)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:40.188396 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:40.313641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921b9d4511ff460d89b35ff72717b0a1', 'request_id': 'req-6274732b-7809-4db4-8ad5-d14a529f73a9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:40.320199 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921b9d4511ff460d89b35ff72717b0a1', 'request_id': 'req-6274732b-7809-4db4-8ad5-d14a529f73a9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:40.395917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921b9d4511ff460d89b35ff72717b0a1', 'request_id': 'req-6274732b-7809-4db4-8ad5-d14a529f73a9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:40.407855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] The token cache is being invalidate because project 921b9d4511ff460d89b35ff72717b0a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:40.408143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:40.408834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6274732b-7809-4db4-8ad5-d14a529f73a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:40.410341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1062/2113] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:40 2022] DELETE /identity/v3/projects/921b9d4511ff460d89b35ff72717b0a1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:40.415388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedd66e-3425-49ec-92c9-e9daa3dd72a5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:40.415867 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedd66e-3425-49ec-92c9-e9daa3dd72a5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:40.415994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedd66e-3425-49ec-92c9-e9daa3dd72a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:40.437385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7dedd66e-3425-49ec-92c9-e9daa3dd72a5 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:40.438536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7dedd66e-3425-49ec-92c9-e9daa3dd72a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:40.497421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1052/2114] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:40.505510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60972777-5cca-47da-990e-d9645ee2a241 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:40.505799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60972777-5cca-47da-990e-d9645ee2a241 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:40.506083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60972777-5cca-47da-990e-d9645ee2a241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:40.527677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-60972777-5cca-47da-990e-d9645ee2a241 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:40.528937 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-60972777-5cca-47da-990e-d9645ee2a241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:40.537038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1063/2115] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:40.541173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedd66e-3425-49ec-92c9-e9daa3dd72a5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:40.550887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedd66e-3425-49ec-92c9-e9daa3dd72a5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:40.555415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9b49f-53f9-4c11-ae93-dcd2ac38f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:40.556549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9b49f-53f9-4c11-ae93-dcd2ac38f35c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:40.556834 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9b49f-53f9-4c11-ae93-dcd2ac38f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:40.557110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9b49f-53f9-4c11-ae93-dcd2ac38f35c admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:40.557787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9b49f-53f9-4c11-ae93-dcd2ac38f35c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:21:40.558089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9b49f-53f9-4c11-ae93-dcd2ac38f35c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:40.559674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9b49f-53f9-4c11-ae93-dcd2ac38f35c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:40.571056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1053/2116] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:21:40.575977 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60972777-5cca-47da-990e-d9645ee2a241 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:40.585906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60972777-5cca-47da-990e-d9645ee2a241 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:40.590910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb9bd3-bba5-4600-9351-8c8a92d3daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:40.593695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb9bd3-bba5-4600-9351-8c8a92d3daa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:40.594051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb9bd3-bba5-4600-9351-8c8a92d3daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:40.594397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb9bd3-bba5-4600-9351-8c8a92d3daa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:40.595124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb9bd3-bba5-4600-9351-8c8a92d3daa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:40.597099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb9bd3-bba5-4600-9351-8c8a92d3daa9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:40.678258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1064/2117] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:40 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:40.689728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9b49f-53f9-4c11-ae93-dcd2ac38f35c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:40.700791 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9b49f-53f9-4c11-ae93-dcd2ac38f35c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:40.766645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8c218-768c-4b0f-80f0-f45a43f006a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:40.767280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8c218-768c-4b0f-80f0-f45a43f006a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:40.767560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8c218-768c-4b0f-80f0-f45a43f006a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:40.767835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8c218-768c-4b0f-80f0-f45a43f006a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:40.768520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8c218-768c-4b0f-80f0-f45a43f006a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:40.770619 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8c218-768c-4b0f-80f0-f45a43f006a5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:40.882326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1054/2118] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:40 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:21:40.886902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb9bd3-bba5-4600-9351-8c8a92d3daa9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:40.901581 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb9bd3-bba5-4600-9351-8c8a92d3daa9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:40.909002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97fc72-b641-4f84-b885-6671b5a861bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:40.909002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97fc72-b641-4f84-b885-6671b5a861bb admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:40.909002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97fc72-b641-4f84-b885-6671b5a861bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:40.909002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97fc72-b641-4f84-b885-6671b5a861bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:40.910763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97fc72-b641-4f84-b885-6671b5a861bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:40.911474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97fc72-b641-4f84-b885-6671b5a861bb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:40.928399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1065/2119] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:40.929753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8c218-768c-4b0f-80f0-f45a43f006a5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:40.940631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8c218-768c-4b0f-80f0-f45a43f006a5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:40.945555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb890-9f82-4f15-aab4-822e77ce1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:40.946271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb890-9f82-4f15-aab4-822e77ce1fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:40.946565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb890-9f82-4f15-aab4-822e77ce1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:40.946872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb890-9f82-4f15-aab4-822e77ce1fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:40.947655 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb890-9f82-4f15-aab4-822e77ce1fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:40.949338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb890-9f82-4f15-aab4-822e77ce1fe8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:40.960439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1055/2120] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:40.964675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97fc72-b641-4f84-b885-6671b5a861bb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:40.974673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97fc72-b641-4f84-b885-6671b5a861bb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:40.980862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93bf35-6319-48e8-86c3-488103f759d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:40.988184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93bf35-6319-48e8-86c3-488103f759d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:40.988184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93bf35-6319-48e8-86c3-488103f759d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:40.988184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93bf35-6319-48e8-86c3-488103f759d5 admin admin] PATH_INFO: `/v3/projects/76081f2f18a646eb9a2c4edbefcc4ed7/users/02738d3604e2453e807e7d563abda982/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:41.000018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93bf35-6319-48e8-86c3-488103f759d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76081f2f18a646eb9a2c4edbefcc4ed7, user_id=02738d3604e2453e807e7d563abda982, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:41.002742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93bf35-6319-48e8-86c3-488103f759d5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:41.106396 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1066/2121] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:40 2022] PUT /identity/v3/projects/76081f2f18a646eb9a2c4edbefcc4ed7/users/02738d3604e2453e807e7d563abda982/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:41.111938 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdff92-1d55-4c8a-9bf5-486926d64f73 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:41.112258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdff92-1d55-4c8a-9bf5-486926d64f73 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:41.112552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdff92-1d55-4c8a-9bf5-486926d64f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:41.121010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:41.134344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-adfdff92-1d55-4c8a-9bf5-486926d64f73 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:41.135593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-adfdff92-1d55-4c8a-9bf5-486926d64f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:41.216463 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1056/2122] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:41.224242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93bf35-6319-48e8-86c3-488103f759d5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:41.226211 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-db93bf35-6319-48e8-86c3-488103f759d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:41.297539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93bf35-6319-48e8-86c3-488103f759d5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:41.301255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05076211-e57b-4cc5-ac00-af12aebc7cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:41.301865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05076211-e57b-4cc5-ac00-af12aebc7cfc service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:41.302151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05076211-e57b-4cc5-ac00-af12aebc7cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:41.302419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05076211-e57b-4cc5-ac00-af12aebc7cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:41.312050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05076211-e57b-4cc5-ac00-af12aebc7cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:41.313546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05076211-e57b-4cc5-ac00-af12aebc7cfc service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:41.323959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1067/2123] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:42.654044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5b82-c557-4872-8baf-d11ff33e3ad0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:42.654545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5b82-c557-4872-8baf-d11ff33e3ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:42.657088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5b82-c557-4872-8baf-d11ff33e3ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:42.688914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-84ce5b82-c557-4872-8baf-d11ff33e3ad0 None None] MFA Rules not processed for user `02738d3604e2453e807e7d563abda982`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:42.690146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-84ce5b82-c557-4872-8baf-d11ff33e3ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:42.760571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1057/2124] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:42.772745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05076211-e57b-4cc5-ac00-af12aebc7cfc service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:42.774179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-05076211-e57b-4cc5-ac00-af12aebc7cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:42.796033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:42.831143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05076211-e57b-4cc5-ac00-af12aebc7cfc service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:42.838375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9728d-b0c1-45ae-8679-4f807d742caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:42.838375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9728d-b0c1-45ae-8679-4f807d742caa service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:42.838375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9728d-b0c1-45ae-8679-4f807d742caa service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:42.838375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9728d-b0c1-45ae-8679-4f807d742caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:42.844706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9728d-b0c1-45ae-8679-4f807d742caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:42.846132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9728d-b0c1-45ae-8679-4f807d742caa service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:42.854930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1068/2125] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:45.567906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc639525-e44d-4052-a83d-0da3b5cd3480 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:45.568551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc639525-e44d-4052-a83d-0da3b5cd3480 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:45.568551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc639525-e44d-4052-a83d-0da3b5cd3480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:45.588167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cc639525-e44d-4052-a83d-0da3b5cd3480 None None] MFA Rules not processed for user `02738d3604e2453e807e7d563abda982`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:45.589476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cc639525-e44d-4052-a83d-0da3b5cd3480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:45.597116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1058/2126] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:46.353714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8ea99-e664-482a-ab4b-66432d4a03c7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:46.354229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8ea99-e664-482a-ab4b-66432d4a03c7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:46.354229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8ea99-e664-482a-ab4b-66432d4a03c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:46.375866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-79e8ea99-e664-482a-ab4b-66432d4a03c7 None None] MFA Rules not processed for user `2e9410daf1b242f8ba5ed06e8d4556d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:46.377032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-79e8ea99-e664-482a-ab4b-66432d4a03c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:46.446703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1069/2127] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:52.426705 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc639525-e44d-4052-a83d-0da3b5cd3480 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:52.430794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cc639525-e44d-4052-a83d-0da3b5cd3480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:52.442229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc639525-e44d-4052-a83d-0da3b5cd3480 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:52.447718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:52.448612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:52.448910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:52.449193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] PATH_INFO: `/v3/users/82d9d5ae24134300879eb34732a9dff3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:52.450370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d9d5ae24134300879eb34732a9dff3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:52.452363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:52.672124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d9d5ae24134300879eb34732a9dff3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:52.679038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d9d5ae24134300879eb34732a9dff3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:52.743454 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d9d5ae24134300879eb34732a9dff3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:52.744105 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d9d5ae24134300879eb34732a9dff3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:52.744736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d9d5ae24134300879eb34732a9dff3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:52.758111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:52.763102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1059/2128] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:21:52 2022] DELETE /identity/v3/users/82d9d5ae24134300879eb34732a9dff3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:52.767630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b957-d458-41f7-8f28-916e939fbece None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:52.768111 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b957-d458-41f7-8f28-916e939fbece None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:52.768241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b957-d458-41f7-8f28-916e939fbece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:52.788118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ec99b957-d458-41f7-8f28-916e939fbece None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:52.789429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ec99b957-d458-41f7-8f28-916e939fbece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:52.849780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1070/2129] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:52.859474 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:52.862913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:52.919563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf7c98-2588-453a-963d-b2fa76eea170 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:52.923496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae446ad-b7bc-46b0-9337-9b5130500090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:52.924460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae446ad-b7bc-46b0-9337-9b5130500090 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:52.924847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae446ad-b7bc-46b0-9337-9b5130500090 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:52.925220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae446ad-b7bc-46b0-9337-9b5130500090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:52.934448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae446ad-b7bc-46b0-9337-9b5130500090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:52.935873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae446ad-b7bc-46b0-9337-9b5130500090 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:52.948419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1060/2130] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:21:53.351401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99b957-d458-41f7-8f28-916e939fbece None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:53.352843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ec99b957-d458-41f7-8f28-916e939fbece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:53.365471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99b957-d458-41f7-8f28-916e939fbece None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:53.369970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:53.370612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:53.370891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:53.371167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] PATH_INFO: `/v3/projects/22199acbbd0d404fbd22bdfa0ef2519d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:53.372377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22199acbbd0d404fbd22bdfa0ef2519d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:53.374538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:53.493940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22199acbbd0d404fbd22bdfa0ef2519d', 'request_id': 'req-951371a8-8aaf-4a2c-9ee1-196c611a29a4'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:53.501102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22199acbbd0d404fbd22bdfa0ef2519d', 'request_id': 'req-951371a8-8aaf-4a2c-9ee1-196c611a29a4'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:53.596435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22199acbbd0d404fbd22bdfa0ef2519d', 'request_id': 'req-951371a8-8aaf-4a2c-9ee1-196c611a29a4'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:53.605368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:53.608811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] The token cache is being invalidate because project 22199acbbd0d404fbd22bdfa0ef2519d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:21:53.609110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:53.609775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-951371a8-8aaf-4a2c-9ee1-196c611a29a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:21:53.611577 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1071/2131] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:21:53 2022] DELETE /identity/v3/projects/22199acbbd0d404fbd22bdfa0ef2519d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:53.616223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18423d-47b4-42ee-8a81-750e4a9030ab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:53.616718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18423d-47b4-42ee-8a81-750e4a9030ab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:53.616954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18423d-47b4-42ee-8a81-750e4a9030ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:53.637482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2c18423d-47b4-42ee-8a81-750e4a9030ab None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:53.638684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c18423d-47b4-42ee-8a81-750e4a9030ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:53.699821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1061/2132] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:21:53.708856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e250b9-624f-4d22-abb3-5ac50d35cf57 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:53.708856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e250b9-624f-4d22-abb3-5ac50d35cf57 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:53.709209 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e250b9-624f-4d22-abb3-5ac50d35cf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:53.729113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-80e250b9-624f-4d22-abb3-5ac50d35cf57 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:53.730314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-80e250b9-624f-4d22-abb3-5ac50d35cf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:53.738153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1072/2133] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:53.742943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18423d-47b4-42ee-8a81-750e4a9030ab None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:53.753111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18423d-47b4-42ee-8a81-750e4a9030ab None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:53.757773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b270441-ef78-434f-9c14-21579655fbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:53.758366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b270441-ef78-434f-9c14-21579655fbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:53.758643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b270441-ef78-434f-9c14-21579655fbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:53.758917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b270441-ef78-434f-9c14-21579655fbb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:53.759563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b270441-ef78-434f-9c14-21579655fbb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:21:53.759876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b270441-ef78-434f-9c14-21579655fbb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:53.761519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b270441-ef78-434f-9c14-21579655fbb4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:53.773396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1062/2134] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:21:53.777803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e250b9-624f-4d22-abb3-5ac50d35cf57 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:53.787365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e250b9-624f-4d22-abb3-5ac50d35cf57 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:53.792923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad78471-af5b-4067-a934-e6fffa10f811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:53.793527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad78471-af5b-4067-a934-e6fffa10f811 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:53.793808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad78471-af5b-4067-a934-e6fffa10f811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:53.794082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad78471-af5b-4067-a934-e6fffa10f811 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:53.794727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad78471-af5b-4067-a934-e6fffa10f811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:53.796835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad78471-af5b-4067-a934-e6fffa10f811 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:53.894810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1073/2135] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:21:53 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:21:53.899009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b270441-ef78-434f-9c14-21579655fbb4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:53.908826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b270441-ef78-434f-9c14-21579655fbb4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:53.965893 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffadccd-dab9-43f4-bd03-0580c6c077bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:53.966543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffadccd-dab9-43f4-bd03-0580c6c077bb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:53.966844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffadccd-dab9-43f4-bd03-0580c6c077bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:53.967126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffadccd-dab9-43f4-bd03-0580c6c077bb admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:53.967801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffadccd-dab9-43f4-bd03-0580c6c077bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:53.969766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffadccd-dab9-43f4-bd03-0580c6c077bb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:54.076962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1063/2136] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:21:53 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:21:54.081114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad78471-af5b-4067-a934-e6fffa10f811 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:54.094111 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad78471-af5b-4067-a934-e6fffa10f811 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:54.105766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22902ec-8e7e-41cb-843b-9e70109cb23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:54.106466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22902ec-8e7e-41cb-843b-9e70109cb23c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:54.106818 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22902ec-8e7e-41cb-843b-9e70109cb23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:54.107161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22902ec-8e7e-41cb-843b-9e70109cb23c admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:54.107897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22902ec-8e7e-41cb-843b-9e70109cb23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:54.109655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22902ec-8e7e-41cb-843b-9e70109cb23c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:54.122051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1074/2137] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:21:54.126473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffadccd-dab9-43f4-bd03-0580c6c077bb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:54.137215 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffadccd-dab9-43f4-bd03-0580c6c077bb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:54.142337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade36f0-441a-4383-bf8c-753f24569faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:54.154577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade36f0-441a-4383-bf8c-753f24569faf admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:54.154577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade36f0-441a-4383-bf8c-753f24569faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:54.154577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade36f0-441a-4383-bf8c-753f24569faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:54.154577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade36f0-441a-4383-bf8c-753f24569faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:54.154577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade36f0-441a-4383-bf8c-753f24569faf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:54.164945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1064/2138] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:21:54.169903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22902ec-8e7e-41cb-843b-9e70109cb23c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:54.180177 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22902ec-8e7e-41cb-843b-9e70109cb23c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:54.185027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255d960-1963-47a5-b426-cc88ab994b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:54.188743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255d960-1963-47a5-b426-cc88ab994b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:54.188743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255d960-1963-47a5-b426-cc88ab994b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:54.188743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255d960-1963-47a5-b426-cc88ab994b4b admin admin] PATH_INFO: `/v3/projects/4cf9242b6eab49ce83a56af84bc32269/users/9d786a40e8ba410aa6dd7227db32d4c0/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:54.206015 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255d960-1963-47a5-b426-cc88ab994b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf9242b6eab49ce83a56af84bc32269, user_id=9d786a40e8ba410aa6dd7227db32d4c0, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:54.208809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255d960-1963-47a5-b426-cc88ab994b4b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:54.295236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1075/2139] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:21:54 2022] PUT /identity/v3/projects/4cf9242b6eab49ce83a56af84bc32269/users/9d786a40e8ba410aa6dd7227db32d4c0/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:21:54.305550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb15a-b070-4d1b-bd57-eea2fbe30fac None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:54.305826 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb15a-b070-4d1b-bd57-eea2fbe30fac None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:54.306688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb15a-b070-4d1b-bd57-eea2fbe30fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:54.322477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:21:54.338051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-146fb15a-b070-4d1b-bd57-eea2fbe30fac None None] MFA Rules not processed for user `9d786a40e8ba410aa6dd7227db32d4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:21:54.339338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-146fb15a-b070-4d1b-bd57-eea2fbe30fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:54.404678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1065/2140] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:21:54.416353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255d960-1963-47a5-b426-cc88ab994b4b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:21:54.418070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d255d960-1963-47a5-b426-cc88ab994b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:21:54.474081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255d960-1963-47a5-b426-cc88ab994b4b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:21:54.477651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45975384-2488-435f-ade7-0ebcecf7d81c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:21:54.478765 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45975384-2488-435f-ade7-0ebcecf7d81c service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:21:54.479043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45975384-2488-435f-ade7-0ebcecf7d81c service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:21:54.479375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45975384-2488-435f-ade7-0ebcecf7d81c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:21:54.487436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45975384-2488-435f-ade7-0ebcecf7d81c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:21:54.488982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45975384-2488-435f-ade7-0ebcecf7d81c service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:21:54.498818 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1076/2141] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:22:04.419171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=29 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:04.494433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=56,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:08.411642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fb15a-b070-4d1b-bd57-eea2fbe30fac None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:08.413293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-146fb15a-b070-4d1b-bd57-eea2fbe30fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:08.486095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fb15a-b070-4d1b-bd57-eea2fbe30fac None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:08.491056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:08.491821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:08.492180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:08.492639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] PATH_INFO: `/v3/users/35bfeb94e4a44a76abcd991c64c54348` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:08.494373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35bfeb94e4a44a76abcd991c64c54348)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:08.497088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:08.669918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35bfeb94e4a44a76abcd991c64c54348'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:08.676903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35bfeb94e4a44a76abcd991c64c54348'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:08.779293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35bfeb94e4a44a76abcd991c64c54348'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:08.779959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35bfeb94e4a44a76abcd991c64c54348'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:08.780658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35bfeb94e4a44a76abcd991c64c54348'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:08.799413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1066/2142] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:22:08 2022] DELETE /identity/v3/users/35bfeb94e4a44a76abcd991c64c54348 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:22:08.803852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf417-1e7f-4e32-98c6-c0c937dc1aad None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:08.804341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf417-1e7f-4e32-98c6-c0c937dc1aad None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:08.804507 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf417-1e7f-4e32-98c6-c0c937dc1aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:08.823236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a39cf417-1e7f-4e32-98c6-c0c937dc1aad None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:08.824929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a39cf417-1e7f-4e32-98c6-c0c937dc1aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:08.906594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1077/2143] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:08.945824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:08.947349 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:09.025456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65bb9d-7f4d-4d8d-992c-a134f4e8b447 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:09.029677 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de2c47-3d8a-40dc-b00a-f7a139c3c8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:09.030446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2c47-3d8a-40dc-b00a-f7a139c3c8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:09.030824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2c47-3d8a-40dc-b00a-f7a139c3c8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:09.031160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2c47-3d8a-40dc-b00a-f7a139c3c8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:09.040307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de2c47-3d8a-40dc-b00a-f7a139c3c8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:09.041802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de2c47-3d8a-40dc-b00a-f7a139c3c8c0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:09.052064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1067/2144] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:22:09.409381 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf417-1e7f-4e32-98c6-c0c937dc1aad None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:09.410817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a39cf417-1e7f-4e32-98c6-c0c937dc1aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:09.422964 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf417-1e7f-4e32-98c6-c0c937dc1aad None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:09.428133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:09.429220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:09.429220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:09.429944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] PATH_INFO: `/v3/users/9d786a40e8ba410aa6dd7227db32d4c0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:09.430866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d786a40e8ba410aa6dd7227db32d4c0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:09.432933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:09.625864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d786a40e8ba410aa6dd7227db32d4c0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:09.633225 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d786a40e8ba410aa6dd7227db32d4c0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:09.633996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d786a40e8ba410aa6dd7227db32d4c0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:09.711005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d786a40e8ba410aa6dd7227db32d4c0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:09.724713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d786a40e8ba410aa6dd7227db32d4c0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:09.730939 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1078/2145] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:22:09 2022] DELETE /identity/v3/users/9d786a40e8ba410aa6dd7227db32d4c0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:22:09.735564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115f12b-23d2-4015-a2f6-e2c22256992f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:09.736080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115f12b-23d2-4015-a2f6-e2c22256992f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:09.736180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115f12b-23d2-4015-a2f6-e2c22256992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:09.756242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1115f12b-23d2-4015-a2f6-e2c22256992f None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:09.757512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1115f12b-23d2-4015-a2f6-e2c22256992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:09.778496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:09.823022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1068/2146] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:09.833831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:09.835652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:09.901903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0bba-e4d0-4ef0-a8a4-ce291b06cedc admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:09.905886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368af9-bd26-4a80-971b-d614333382bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:09.906693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368af9-bd26-4a80-971b-d614333382bf service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:09.906810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368af9-bd26-4a80-971b-d614333382bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:09.907027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368af9-bd26-4a80-971b-d614333382bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:09.918548 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13368af9-bd26-4a80-971b-d614333382bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:09.919992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13368af9-bd26-4a80-971b-d614333382bf service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:09.931605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1079/2147] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:22:10.241769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115f12b-23d2-4015-a2f6-e2c22256992f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:10.243863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1115f12b-23d2-4015-a2f6-e2c22256992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:10.272152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115f12b-23d2-4015-a2f6-e2c22256992f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:10.283948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:10.285363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:10.285988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:10.285988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] PATH_INFO: `/v3/projects/9ef7984bfb9c4101b7050247eeb5d6ba` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:10.287262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef7984bfb9c4101b7050247eeb5d6ba)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:10.291402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:10.511109 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef7984bfb9c4101b7050247eeb5d6ba', 'request_id': 'req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:10.518240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef7984bfb9c4101b7050247eeb5d6ba', 'request_id': 'req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:10.525059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef7984bfb9c4101b7050247eeb5d6ba', 'request_id': 'req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:10.531839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368af9-bd26-4a80-971b-d614333382bf service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:10.533200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-13368af9-bd26-4a80-971b-d614333382bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:10.546231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368af9-bd26-4a80-971b-d614333382bf service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:10.559181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:10.608238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:10.608573 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:10.608852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:10.609173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] PATH_INFO: `/v3/projects/4cf9242b6eab49ce83a56af84bc32269` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:10.610263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf9242b6eab49ce83a56af84bc32269)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:10.612199 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:10.622699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] The token cache is being invalidate because project 9ef7984bfb9c4101b7050247eeb5d6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:22:10.622699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:10.622699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fed270a4-ce3c-40ec-a0b7-b08c1573a6b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:10.622699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1069/2148] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:22:10 2022] DELETE /identity/v3/projects/9ef7984bfb9c4101b7050247eeb5d6ba => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:22:10.624350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0904ebf-c7f9-4480-85e9-67f970612ddc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:10.624649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0904ebf-c7f9-4480-85e9-67f970612ddc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:10.624913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0904ebf-c7f9-4480-85e9-67f970612ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:10.653584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e0904ebf-c7f9-4480-85e9-67f970612ddc None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:10.654823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e0904ebf-c7f9-4480-85e9-67f970612ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:10.664117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1070/2149] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:10.672095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435c52-7a0d-477b-a511-91a0666217c4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:10.672407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435c52-7a0d-477b-a511-91a0666217c4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:10.672689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435c52-7a0d-477b-a511-91a0666217c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:10.703392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-23435c52-7a0d-477b-a511-91a0666217c4 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:10.704633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-23435c52-7a0d-477b-a511-91a0666217c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:10.717092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1071/2150] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:22:10.722101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23435c52-7a0d-477b-a511-91a0666217c4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:10.733342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23435c52-7a0d-477b-a511-91a0666217c4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:10.738838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93567017-1227-4fd1-b745-1a21f0735165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:10.740100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93567017-1227-4fd1-b745-1a21f0735165 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:10.740414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93567017-1227-4fd1-b745-1a21f0735165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:10.740692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93567017-1227-4fd1-b745-1a21f0735165 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:10.741341 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93567017-1227-4fd1-b745-1a21f0735165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:22:10.741651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93567017-1227-4fd1-b745-1a21f0735165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:10.743284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93567017-1227-4fd1-b745-1a21f0735165 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:10.760411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1072/2151] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:22:10.766486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93567017-1227-4fd1-b745-1a21f0735165 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:10.784334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93567017-1227-4fd1-b745-1a21f0735165 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:10.784623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf9242b6eab49ce83a56af84bc32269', 'request_id': 'req-ef8516aa-27a0-487f-a4f7-e18eb807a93d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:10.793596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf9242b6eab49ce83a56af84bc32269', 'request_id': 'req-ef8516aa-27a0-487f-a4f7-e18eb807a93d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:10.847853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d933-29fd-47dc-b43d-813672e4eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:10.848499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d933-29fd-47dc-b43d-813672e4eaba admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:10.848786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d933-29fd-47dc-b43d-813672e4eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:10.849059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d933-29fd-47dc-b43d-813672e4eaba admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:10.849697 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d933-29fd-47dc-b43d-813672e4eaba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:10.851664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d933-29fd-47dc-b43d-813672e4eaba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:10.874213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf9242b6eab49ce83a56af84bc32269', 'request_id': 'req-ef8516aa-27a0-487f-a4f7-e18eb807a93d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:10.885800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] The token cache is being invalidate because project 4cf9242b6eab49ce83a56af84bc32269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:22:10.886236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:10.886965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ef8516aa-27a0-487f-a4f7-e18eb807a93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:10.888712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1080/2152] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:22:10 2022] DELETE /identity/v3/projects/4cf9242b6eab49ce83a56af84bc32269 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:22:10.893333 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd532-2f4f-4006-b562-5d457c3cdc2a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:10.893713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd532-2f4f-4006-b562-5d457c3cdc2a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:10.894197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd532-2f4f-4006-b562-5d457c3cdc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:10.915281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a30fd532-2f4f-4006-b562-5d457c3cdc2a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:10.916560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a30fd532-2f4f-4006-b562-5d457c3cdc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:10.925558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1081/2153] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:22:10.933754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe827-f2ac-44e7-bad2-d97f9c00df70 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:10.934051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe827-f2ac-44e7-bad2-d97f9c00df70 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:10.934328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe827-f2ac-44e7-bad2-d97f9c00df70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:10.955453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f3ebe827-f2ac-44e7-bad2-d97f9c00df70 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:10.956729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f3ebe827-f2ac-44e7-bad2-d97f9c00df70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:10.964856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1082/2154] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:22:10.970169 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebe827-f2ac-44e7-bad2-d97f9c00df70 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:10.979479 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebe827-f2ac-44e7-bad2-d97f9c00df70 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:10.984909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85efe-43df-421e-9444-ddcc202992a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:10.985543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85efe-43df-421e-9444-ddcc202992a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:10.985824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85efe-43df-421e-9444-ddcc202992a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:10.986097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85efe-43df-421e-9444-ddcc202992a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:10.986748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e85efe-43df-421e-9444-ddcc202992a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:22:10.987050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e85efe-43df-421e-9444-ddcc202992a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:10.988686 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e85efe-43df-421e-9444-ddcc202992a9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.002534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1083/2155] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:22:11.007571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1073/2156] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:22:10 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:22:11.007750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85efe-43df-421e-9444-ddcc202992a9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.012767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d933-29fd-47dc-b43d-813672e4eaba admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.014522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d71d933-29fd-47dc-b43d-813672e4eaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:11.018850 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85efe-43df-421e-9444-ddcc202992a9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.022864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:11.088815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a77e-7378-4e3d-adca-f7d9eac7a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.092652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a77e-7378-4e3d-adca-f7d9eac7a72b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.092652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a77e-7378-4e3d-adca-f7d9eac7a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.092652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a77e-7378-4e3d-adca-f7d9eac7a72b admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.092652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27a77e-7378-4e3d-adca-f7d9eac7a72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.092652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27a77e-7378-4e3d-adca-f7d9eac7a72b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.100852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d933-29fd-47dc-b43d-813672e4eaba admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.107538 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68501433-a4a3-494d-b659-f9f482e1b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.108405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501433-a4a3-494d-b659-f9f482e1b556 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.108692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501433-a4a3-494d-b659-f9f482e1b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.109451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501433-a4a3-494d-b659-f9f482e1b556 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.110199 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68501433-a4a3-494d-b659-f9f482e1b556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.112150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68501433-a4a3-494d-b659-f9f482e1b556 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.208415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1074/2157] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:22:11 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:22:11.208912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1084/2158] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:22:11 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:22:11.213263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68501433-a4a3-494d-b659-f9f482e1b556 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.213729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a77e-7378-4e3d-adca-f7d9eac7a72b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.224957 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68501433-a4a3-494d-b659-f9f482e1b556 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.291328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da0fa-aa6a-46e4-b28c-4981b9ad20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.291942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da0fa-aa6a-46e4-b28c-4981b9ad20b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.292261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da0fa-aa6a-46e4-b28c-4981b9ad20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.293184 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da0fa-aa6a-46e4-b28c-4981b9ad20b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.293885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0da0fa-aa6a-46e4-b28c-4981b9ad20b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.295824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0da0fa-aa6a-46e4-b28c-4981b9ad20b3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.305256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a77e-7378-4e3d-adca-f7d9eac7a72b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.310274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8a4a9-b673-457e-937a-c37a933ac204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.310955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8a4a9-b673-457e-937a-c37a933ac204 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.311235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8a4a9-b673-457e-937a-c37a933ac204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.311503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8a4a9-b673-457e-937a-c37a933ac204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.312287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8a4a9-b673-457e-937a-c37a933ac204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.313855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8a4a9-b673-457e-937a-c37a933ac204 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.324667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1085/2159] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:22:11.325808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791281b-3ba9-459f-a853-1d0ef82c46ee None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.326195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791281b-3ba9-459f-a853-1d0ef82c46ee None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.326509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791281b-3ba9-459f-a853-1d0ef82c46ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.344978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9791281b-3ba9-459f-a853-1d0ef82c46ee None None] MFA Rules not processed for user `02738d3604e2453e807e7d563abda982`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:11.350319 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9791281b-3ba9-459f-a853-1d0ef82c46ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:11.400838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1075/2160] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:22:11 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:22:11.401400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1086/2161] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:11.402775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791281b-3ba9-459f-a853-1d0ef82c46ee None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.403091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da0fa-aa6a-46e4-b28c-4981b9ad20b3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.416377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791281b-3ba9-459f-a853-1d0ef82c46ee None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.421651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852854-0323-4927-8368-e2cec80e2fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.422272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da0fa-aa6a-46e4-b28c-4981b9ad20b3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.422411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852854-0323-4927-8368-e2cec80e2fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.425200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852854-0323-4927-8368-e2cec80e2fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.425200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852854-0323-4927-8368-e2cec80e2fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.425200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852854-0323-4927-8368-e2cec80e2fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.425200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852854-0323-4927-8368-e2cec80e2fb1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.428943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a936a23-d70c-4529-9fed-e8b1b00af648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.429615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a936a23-d70c-4529-9fed-e8b1b00af648 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.429899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a936a23-d70c-4529-9fed-e8b1b00af648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.430177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a936a23-d70c-4529-9fed-e8b1b00af648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.431600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a936a23-d70c-4529-9fed-e8b1b00af648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.433565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a936a23-d70c-4529-9fed-e8b1b00af648 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.439210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1087/2162] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:22:11.440100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852854-0323-4927-8368-e2cec80e2fb1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.449817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852854-0323-4927-8368-e2cec80e2fb1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.458583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1076/2163] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:22:11.459072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464547b3-0fa8-49c5-9987-89920c09e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.459072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464547b3-0fa8-49c5-9987-89920c09e4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.459072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464547b3-0fa8-49c5-9987-89920c09e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.459072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464547b3-0fa8-49c5-9987-89920c09e4dc admin admin] PATH_INFO: `/v3/projects/4c471f5ced7e4ce09a990717c776e483/users/84cdb167f7ce4bc081ce4d5e60841061/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.461265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a936a23-d70c-4529-9fed-e8b1b00af648 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.472844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a936a23-d70c-4529-9fed-e8b1b00af648 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.475059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464547b3-0fa8-49c5-9987-89920c09e4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c471f5ced7e4ce09a990717c776e483, user_id=84cdb167f7ce4bc081ce4d5e60841061, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.477761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464547b3-0fa8-49c5-9987-89920c09e4dc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.477941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4cf78-26d0-4cba-9435-010497db443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.483174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4cf78-26d0-4cba-9435-010497db443c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.483174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4cf78-26d0-4cba-9435-010497db443c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.483174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4cf78-26d0-4cba-9435-010497db443c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.483174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4cf78-26d0-4cba-9435-010497db443c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.484563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4cf78-26d0-4cba-9435-010497db443c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.494028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:11.496250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1077/2164] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:22:11.499573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4cf78-26d0-4cba-9435-010497db443c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.509119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4cf78-26d0-4cba-9435-010497db443c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.514386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fde81c-1683-4472-b861-346e5dfe16b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.515031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fde81c-1683-4472-b861-346e5dfe16b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.515293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fde81c-1683-4472-b861-346e5dfe16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.515566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fde81c-1683-4472-b861-346e5dfe16b8 admin admin] PATH_INFO: `/v3/projects/8b775eada8044ab786ca87d4e2a46d8c/users/e6e0c23ec6a94cc3b71e1f1a9b2979ee/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.533699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fde81c-1683-4472-b861-346e5dfe16b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b775eada8044ab786ca87d4e2a46d8c, user_id=e6e0c23ec6a94cc3b71e1f1a9b2979ee, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.536722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fde81c-1683-4472-b861-346e5dfe16b8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.557637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1088/2165] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:22:11 2022] PUT /identity/v3/projects/4c471f5ced7e4ce09a990717c776e483/users/84cdb167f7ce4bc081ce4d5e60841061/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:22:11.562367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa446-bb46-44c3-b5f6-9897b0e13069 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.562654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa446-bb46-44c3-b5f6-9897b0e13069 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.563097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa446-bb46-44c3-b5f6-9897b0e13069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.582198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e13fa446-bb46-44c3-b5f6-9897b0e13069 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:11.583408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e13fa446-bb46-44c3-b5f6-9897b0e13069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:11.612956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1078/2166] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:22:11 2022] PUT /identity/v3/projects/8b775eada8044ab786ca87d4e2a46d8c/users/e6e0c23ec6a94cc3b71e1f1a9b2979ee/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:22:11.623351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033152ff-274c-4fd1-b8eb-46219c89ee2d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.623638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033152ff-274c-4fd1-b8eb-46219c89ee2d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.623912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033152ff-274c-4fd1-b8eb-46219c89ee2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.660287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-033152ff-274c-4fd1-b8eb-46219c89ee2d None None] MFA Rules not processed for user `e6e0c23ec6a94cc3b71e1f1a9b2979ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:11.661525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-033152ff-274c-4fd1-b8eb-46219c89ee2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:11.671309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1089/2167] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:22:11.684329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fa446-bb46-44c3-b5f6-9897b0e13069 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.686127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e13fa446-bb46-44c3-b5f6-9897b0e13069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:11.752042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fa446-bb46-44c3-b5f6-9897b0e13069 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.758820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1079/2168] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:22:11.769553 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:11.770818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033152ff-274c-4fd1-b8eb-46219c89ee2d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:11.773025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-033152ff-274c-4fd1-b8eb-46219c89ee2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:11.819036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ae3a8-b0d8-448d-9461-afae66b7c73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.819772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ae3a8-b0d8-448d-9461-afae66b7c73e service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.820108 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ae3a8-b0d8-448d-9461-afae66b7c73e service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.820479 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ae3a8-b0d8-448d-9461-afae66b7c73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.869924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033152ff-274c-4fd1-b8eb-46219c89ee2d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:11.874613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3fe04-b756-44ac-8501-0809e6c60a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:11.875669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3fe04-b756-44ac-8501-0809e6c60a8c service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:11.875669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3fe04-b756-44ac-8501-0809e6c60a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:11.875859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3fe04-b756-44ac-8501-0809e6c60a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:11.897534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3fe04-b756-44ac-8501-0809e6c60a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.899215 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3fe04-b756-44ac-8501-0809e6c60a8c service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.925483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1080/2169] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:22:11.929947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ae3a8-b0d8-448d-9461-afae66b7c73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:11.931621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ae3a8-b0d8-448d-9461-afae66b7c73e service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:11.945757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1090/2170] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:22:12.151235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:14.956718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2424064-ca4b-46f4-8caa-23d98e0d9ef4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:14.957176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2424064-ca4b-46f4-8caa-23d98e0d9ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:14.957274 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2424064-ca4b-46f4-8caa-23d98e0d9ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:14.979682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a2424064-ca4b-46f4-8caa-23d98e0d9ef4 None None] MFA Rules not processed for user `e6e0c23ec6a94cc3b71e1f1a9b2979ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:14.981458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a2424064-ca4b-46f4-8caa-23d98e0d9ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:14.991068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1081/2171] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:17.636900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ae3a8-b0d8-448d-9461-afae66b7c73e service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:17.638629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cf5ae3a8-b0d8-448d-9461-afae66b7c73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:17.749299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ae3a8-b0d8-448d-9461-afae66b7c73e service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:17.755237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f9038-53c0-451f-9a4f-088a0a6ab2cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:17.755874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f9038-53c0-451f-9a4f-088a0a6ab2cb service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:17.756156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f9038-53c0-451f-9a4f-088a0a6ab2cb service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:17.757144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f9038-53c0-451f-9a4f-088a0a6ab2cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:17.759504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fa3f9038-53c0-451f-9a4f-088a0a6ab2cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:17.776769 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f9038-53c0-451f-9a4f-088a0a6ab2cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:17.780011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f9038-53c0-451f-9a4f-088a0a6ab2cb service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:17.791099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1091/2172] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:22:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:22:19.155330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041687d-4516-4ec3-bb7d-822b5967422b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:19.163652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041687d-4516-4ec3-bb7d-822b5967422b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:19.163652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041687d-4516-4ec3-bb7d-822b5967422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:19.193577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6041687d-4516-4ec3-bb7d-822b5967422b None None] MFA Rules not processed for user `84cdb167f7ce4bc081ce4d5e60841061`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:19.195021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6041687d-4516-4ec3-bb7d-822b5967422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:19.272455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1082/2173] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:19.277767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f9038-53c0-451f-9a4f-088a0a6ab2cb service placement] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:19.289135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f9038-53c0-451f-9a4f-088a0a6ab2cb service placement] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:19.294287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0d5f3-d7da-44c8-8ceb-6cd4c7b0ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:19.295134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0d5f3-d7da-44c8-8ceb-6cd4c7b0ff37 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:19.295569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0d5f3-d7da-44c8-8ceb-6cd4c7b0ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:19.296001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0d5f3-d7da-44c8-8ceb-6cd4c7b0ff37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:19.297060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0d5f3-d7da-44c8-8ceb-6cd4c7b0ff37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:19.299266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0d5f3-d7da-44c8-8ceb-6cd4c7b0ff37 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:19.305170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:19.416605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1092/2174] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:22:19 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:22:19.420965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041687d-4516-4ec3-bb7d-822b5967422b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:19.448042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041687d-4516-4ec3-bb7d-822b5967422b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:19.627037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:19.674541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93223-67ea-4ee9-96de-be209e437eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:19.675187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93223-67ea-4ee9-96de-be209e437eca admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:19.675583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93223-67ea-4ee9-96de-be209e437eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:19.675865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93223-67ea-4ee9-96de-be209e437eca admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:19.676559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93223-67ea-4ee9-96de-be209e437eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:19.678545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93223-67ea-4ee9-96de-be209e437eca admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:19.815454 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1083/2175] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:22:19 2022] POST /identity/v3/users => generated 293 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:22:19.819368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0d5f3-d7da-44c8-8ceb-6cd4c7b0ff37 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:19.836040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0d5f3-d7da-44c8-8ceb-6cd4c7b0ff37 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:19.844275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629c635-7f98-4578-9b2a-4d76e5a3a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:19.846863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c635-7f98-4578-9b2a-4d76e5a3a092 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:19.847372 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c635-7f98-4578-9b2a-4d76e5a3a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:19.847870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c635-7f98-4578-9b2a-4d76e5a3a092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:19.850217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629c635-7f98-4578-9b2a-4d76e5a3a092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:19.852061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629c635-7f98-4578-9b2a-4d76e5a3a092 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:19.878693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1093/2176] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:22:19.882890 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93223-67ea-4ee9-96de-be209e437eca admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:19.896777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93223-67ea-4ee9-96de-be209e437eca admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:19.906864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b2cbe-83ca-4d7c-ad6d-ab45166b7844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:19.907822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2cbe-83ca-4d7c-ad6d-ab45166b7844 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:19.908391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2cbe-83ca-4d7c-ad6d-ab45166b7844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:19.909053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2cbe-83ca-4d7c-ad6d-ab45166b7844 admin admin] PATH_INFO: `/v3/projects/5464cba9f1104dac8492a5a6856048c0/users/c69ca9df4e9641de9d99ad69278b1fdc/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:19.930370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b2cbe-83ca-4d7c-ad6d-ab45166b7844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5464cba9f1104dac8492a5a6856048c0, user_id=c69ca9df4e9641de9d99ad69278b1fdc, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:19.934746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b2cbe-83ca-4d7c-ad6d-ab45166b7844 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:20.015272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1084/2177] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:22:19 2022] PUT /identity/v3/projects/5464cba9f1104dac8492a5a6856048c0/users/c69ca9df4e9641de9d99ad69278b1fdc/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:22:20.019649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629c635-7f98-4578-9b2a-4d76e5a3a092 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:20.030163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629c635-7f98-4578-9b2a-4d76e5a3a092 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:20.089763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4ed46-1b74-4bc6-b2f1-23479618ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:20.090376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ed46-1b74-4bc6-b2f1-23479618ce64 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:20.090660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ed46-1b74-4bc6-b2f1-23479618ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:20.090938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ed46-1b74-4bc6-b2f1-23479618ce64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:20.091586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4ed46-1b74-4bc6-b2f1-23479618ce64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:20.093289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4ed46-1b74-4bc6-b2f1-23479618ce64 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:20.103904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1094/2178] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:22:20.108760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b2cbe-83ca-4d7c-ad6d-ab45166b7844 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:20.119588 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b2cbe-83ca-4d7c-ad6d-ab45166b7844 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:20.125780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71791276-b5b7-4718-81e7-8adb5bf92ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:20.126728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71791276-b5b7-4718-81e7-8adb5bf92ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:20.127183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71791276-b5b7-4718-81e7-8adb5bf92ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:20.127471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71791276-b5b7-4718-81e7-8adb5bf92ac7 admin admin] PATH_INFO: `/v3/projects/5464cba9f1104dac8492a5a6856048c0/users/c69ca9df4e9641de9d99ad69278b1fdc/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:20.129626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71791276-b5b7-4718-81e7-8adb5bf92ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5464cba9f1104dac8492a5a6856048c0, user_id=c69ca9df4e9641de9d99ad69278b1fdc, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:20.132597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71791276-b5b7-4718-81e7-8adb5bf92ac7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:20.149240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1085/2179] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:22:20 2022] PUT /identity/v3/projects/5464cba9f1104dac8492a5a6856048c0/users/c69ca9df4e9641de9d99ad69278b1fdc/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:22:25.682891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ce99-d52a-4d75-8e19-ef4577a3f8b8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:25.683913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ce99-d52a-4d75-8e19-ef4577a3f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:25.684427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89ce99-d52a-4d75-8e19-ef4577a3f8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:25.728484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ea89ce99-d52a-4d75-8e19-ef4577a3f8b8 None None] MFA Rules not processed for user `7699159c5e67464ba6b82ec848c24439`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:25.734229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ea89ce99-d52a-4d75-8e19-ef4577a3f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:25.816257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1095/2180] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:27.637719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050243b-4b81-428c-be0e-4e9628f6ba7f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:27.638603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050243b-4b81-428c-be0e-4e9628f6ba7f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:27.639024 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050243b-4b81-428c-be0e-4e9628f6ba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:27.693072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a050243b-4b81-428c-be0e-4e9628f6ba7f None None] MFA Rules not processed for user `c69ca9df4e9641de9d99ad69278b1fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:27.694456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a050243b-4b81-428c-be0e-4e9628f6ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:27.774424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1086/2181] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:27.845078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ce99-d52a-4d75-8e19-ef4577a3f8b8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:27.846662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ea89ce99-d52a-4d75-8e19-ef4577a3f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:27.932730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89ce99-d52a-4d75-8e19-ef4577a3f8b8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:27.938759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336c62b-6c56-49ab-8bfd-5c63490e96b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:27.939357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336c62b-6c56-49ab-8bfd-5c63490e96b3 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:27.939634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336c62b-6c56-49ab-8bfd-5c63490e96b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:27.939903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336c62b-6c56-49ab-8bfd-5c63490e96b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:27.949684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:27.997241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336c62b-6c56-49ab-8bfd-5c63490e96b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:27.999120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336c62b-6c56-49ab-8bfd-5c63490e96b3 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:28.007954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1096/2182] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:22:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:22:30.924414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fa5c9-f308-4ef3-b61c-46f5b79cb5cf None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:30.925368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fa5c9-f308-4ef3-b61c-46f5b79cb5cf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:30.925802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fa5c9-f308-4ef3-b61c-46f5b79cb5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:30.946980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9d4fa5c9-f308-4ef3-b61c-46f5b79cb5cf None None] MFA Rules not processed for user `84cdb167f7ce4bc081ce4d5e60841061`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:30.956653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d4fa5c9-f308-4ef3-b61c-46f5b79cb5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:30.966236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1087/2183] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:38.080615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=22 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:40.940910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=57,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:48.979529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d768de-99f8-46c6-96d0-78e475a60c08 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:48.980444 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d768de-99f8-46c6-96d0-78e475a60c08 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:48.980728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d768de-99f8-46c6-96d0-78e475a60c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:49.001988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-32d768de-99f8-46c6-96d0-78e475a60c08 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:49.003268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-32d768de-99f8-46c6-96d0-78e475a60c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:49.058893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1097/2184] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:49.100577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fa5c9-f308-4ef3-b61c-46f5b79cb5cf None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:49.101989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d4fa5c9-f308-4ef3-b61c-46f5b79cb5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:49.170797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fa5c9-f308-4ef3-b61c-46f5b79cb5cf None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:49.175733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449c7d7-a277-48c1-bcc1-f244b6a4e67a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:49.176372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449c7d7-a277-48c1-bcc1-f244b6a4e67a service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:49.176683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449c7d7-a277-48c1-bcc1-f244b6a4e67a service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:49.176961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449c7d7-a277-48c1-bcc1-f244b6a4e67a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:49.185646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449c7d7-a277-48c1-bcc1-f244b6a4e67a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:49.187315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449c7d7-a277-48c1-bcc1-f244b6a4e67a service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:49.195613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1088/2185] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:22:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:22:49.607797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365fe8f-6f7b-47a0-8f4f-226d99585a31 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:49.608084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365fe8f-6f7b-47a0-8f4f-226d99585a31 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:49.608399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365fe8f-6f7b-47a0-8f4f-226d99585a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:49.627951 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f365fe8f-6f7b-47a0-8f4f-226d99585a31 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:49.629221 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f365fe8f-6f7b-47a0-8f4f-226d99585a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:49.636648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1098/2186] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:49.648991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449c7d7-a277-48c1-bcc1-f244b6a4e67a service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:49.660764 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449c7d7-a277-48c1-bcc1-f244b6a4e67a service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:49.666387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6d358-60fb-43e9-8ec1-497aa39b08d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:49.668201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d358-60fb-43e9-8ec1-497aa39b08d3 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:49.668201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d358-60fb-43e9-8ec1-497aa39b08d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:49.668201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d358-60fb-43e9-8ec1-497aa39b08d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:49.676643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6d358-60fb-43e9-8ec1-497aa39b08d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:49.678228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6d358-60fb-43e9-8ec1-497aa39b08d3 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:49.686498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1089/2187] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:22:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:22:50.225142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6b3c-5f47-473c-830e-51b14298f4b4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:50.226023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6b3c-5f47-473c-830e-51b14298f4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:50.226465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6b3c-5f47-473c-830e-51b14298f4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:50.269431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-979f6b3c-5f47-473c-830e-51b14298f4b4 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:50.270982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-979f6b3c-5f47-473c-830e-51b14298f4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:50.282972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1099/2188] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 1 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:22:50.300153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6d358-60fb-43e9-8ec1-497aa39b08d3 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:50.312514 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6d358-60fb-43e9-8ec1-497aa39b08d3 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:50.317931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0df249-b92a-4445-b5a9-be9a3dd2946b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:50.318536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0df249-b92a-4445-b5a9-be9a3dd2946b service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:50.318823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0df249-b92a-4445-b5a9-be9a3dd2946b service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:50.319097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0df249-b92a-4445-b5a9-be9a3dd2946b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:50.330519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0df249-b92a-4445-b5a9-be9a3dd2946b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:50.332178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0df249-b92a-4445-b5a9-be9a3dd2946b service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:50.341256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1090/2189] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:22:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:22:51.205325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779a93-573a-496f-b21b-594687330150 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:51.207748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779a93-573a-496f-b21b-594687330150 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:51.207748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779a93-573a-496f-b21b-594687330150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:51.227308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9c779a93-573a-496f-b21b-594687330150 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:51.228734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9c779a93-573a-496f-b21b-594687330150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:51.237673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1100/2190] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:51.251900 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0df249-b92a-4445-b5a9-be9a3dd2946b service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:51.265914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0df249-b92a-4445-b5a9-be9a3dd2946b service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:51.272149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d474f-7c19-466e-a3da-14d38d1c1afc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:51.272806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d474f-7c19-466e-a3da-14d38d1c1afc service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:51.273088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d474f-7c19-466e-a3da-14d38d1c1afc service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:51.273363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d474f-7c19-466e-a3da-14d38d1c1afc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:51.285372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d474f-7c19-466e-a3da-14d38d1c1afc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:51.288086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d474f-7c19-466e-a3da-14d38d1c1afc service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:51.295698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1091/2191] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:22:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:22:52.161807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df9ccc-994d-4f73-8676-66d998864760 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:52.163295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df9ccc-994d-4f73-8676-66d998864760 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:52.164037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df9ccc-994d-4f73-8676-66d998864760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:52.196009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a7df9ccc-994d-4f73-8676-66d998864760 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:52.196009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a7df9ccc-994d-4f73-8676-66d998864760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:52.201304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1101/2192] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 1 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:52.216798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d474f-7c19-466e-a3da-14d38d1c1afc service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:52.233755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d474f-7c19-466e-a3da-14d38d1c1afc service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:52.241212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcabf09-e40f-4df0-bcfc-f2c62307b26e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:52.242066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabf09-e40f-4df0-bcfc-f2c62307b26e service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:52.242423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabf09-e40f-4df0-bcfc-f2c62307b26e service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:52.242788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabf09-e40f-4df0-bcfc-f2c62307b26e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:52.256095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcabf09-e40f-4df0-bcfc-f2c62307b26e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:52.258008 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcabf09-e40f-4df0-bcfc-f2c62307b26e service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:52.267997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1092/2193] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:22:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:22:55.401599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df9ccc-994d-4f73-8676-66d998864760 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:55.503079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df9ccc-994d-4f73-8676-66d998864760 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:55.508034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:55.508843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:55.509203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:55.509623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] PATH_INFO: `/v3/users/e6e0c23ec6a94cc3b71e1f1a9b2979ee` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:55.520934 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e0c23ec6a94cc3b71e1f1a9b2979ee)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:55.527684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:55.776789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e0c23ec6a94cc3b71e1f1a9b2979ee'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:55.794034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e0c23ec6a94cc3b71e1f1a9b2979ee'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:55.797019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e0c23ec6a94cc3b71e1f1a9b2979ee'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:55.910980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e0c23ec6a94cc3b71e1f1a9b2979ee'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:55.931521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e0c23ec6a94cc3b71e1f1a9b2979ee'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:55.935453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:55.956477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1102/2194] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:22:55 2022] DELETE /identity/v3/users/e6e0c23ec6a94cc3b71e1f1a9b2979ee => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:22:55.961629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e552-643e-4731-9c3f-7272cc2c0dfd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:55.962151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e552-643e-4731-9c3f-7272cc2c0dfd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:55.962273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e552-643e-4731-9c3f-7272cc2c0dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:56.026763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c729e552-643e-4731-9c3f-7272cc2c0dfd None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:56.035039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c729e552-643e-4731-9c3f-7272cc2c0dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:56.236993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1093/2195] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:56.244319 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:56.247154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:56.331752 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8caef6-d13f-4b29-ac90-853a1f849db0 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:56.352661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907091e7-84c5-4136-ac52-11f376c668b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:56.353677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907091e7-84c5-4136-ac52-11f376c668b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:56.354195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907091e7-84c5-4136-ac52-11f376c668b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:56.354678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907091e7-84c5-4136-ac52-11f376c668b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:56.377668 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907091e7-84c5-4136-ac52-11f376c668b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:56.382783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907091e7-84c5-4136-ac52-11f376c668b8 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:56.402801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1103/2196] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:22:57.104334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e552-643e-4731-9c3f-7272cc2c0dfd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:57.106409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c729e552-643e-4731-9c3f-7272cc2c0dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:57.123241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e552-643e-4731-9c3f-7272cc2c0dfd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:57.133956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:57.134873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:57.135646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:57.136068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] PATH_INFO: `/v3/projects/8b775eada8044ab786ca87d4e2a46d8c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:57.137483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b775eada8044ab786ca87d4e2a46d8c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:57.139568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:57.404442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:57.418101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b775eada8044ab786ca87d4e2a46d8c', 'request_id': 'req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:57.426339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b775eada8044ab786ca87d4e2a46d8c', 'request_id': 'req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:57.453189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b775eada8044ab786ca87d4e2a46d8c', 'request_id': 'req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:57.587739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] The token cache is being invalidate because project 8b775eada8044ab786ca87d4e2a46d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:22:57.588498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:57.589272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-466b1ccb-1b0f-4d79-be5c-11b34e1c2893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:22:57.592108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1094/2197] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:22:57 2022] DELETE /identity/v3/projects/8b775eada8044ab786ca87d4e2a46d8c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:22:57.597496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220e1c2-0017-4461-9dc5-e1e16d4ed72a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:57.598176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220e1c2-0017-4461-9dc5-e1e16d4ed72a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:57.598176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220e1c2-0017-4461-9dc5-e1e16d4ed72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:57.625684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3220e1c2-0017-4461-9dc5-e1e16d4ed72a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:57.627204 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3220e1c2-0017-4461-9dc5-e1e16d4ed72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:57.758840 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1104/2198] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:57.767396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c5ec-3482-4786-b654-8cf8485555f7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:57.767880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c5ec-3482-4786-b654-8cf8485555f7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:57.768573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c5ec-3482-4786-b654-8cf8485555f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:57.794827 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8fe6c5ec-3482-4786-b654-8cf8485555f7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:57.797917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8fe6c5ec-3482-4786-b654-8cf8485555f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:57.811163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1095/2199] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:22:57.812336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220e1c2-0017-4461-9dc5-e1e16d4ed72a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:57.825572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220e1c2-0017-4461-9dc5-e1e16d4ed72a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:57.831779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0749-1f4c-49fd-8a6c-c3f09bddef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:57.832827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0749-1f4c-49fd-8a6c-c3f09bddef4b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:57.832827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0749-1f4c-49fd-8a6c-c3f09bddef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:57.833027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0749-1f4c-49fd-8a6c-c3f09bddef4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:57.833635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c0749-1f4c-49fd-8a6c-c3f09bddef4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:22:57.833942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c0749-1f4c-49fd-8a6c-c3f09bddef4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:57.835661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c0749-1f4c-49fd-8a6c-c3f09bddef4b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:57.854115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1105/2200] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:22:57.858193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6c5ec-3482-4786-b654-8cf8485555f7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:57.868621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6c5ec-3482-4786-b654-8cf8485555f7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:57.876073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b905eda-447d-48f5-b749-9535f98e6cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:57.876073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905eda-447d-48f5-b749-9535f98e6cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:57.876073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905eda-447d-48f5-b749-9535f98e6cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:57.876073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905eda-447d-48f5-b749-9535f98e6cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:57.876830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b905eda-447d-48f5-b749-9535f98e6cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:57.878823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b905eda-447d-48f5-b749-9535f98e6cbf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:58.031247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1096/2201] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:22:57 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:22:58.033132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0749-1f4c-49fd-8a6c-c3f09bddef4b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:58.066547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0749-1f4c-49fd-8a6c-c3f09bddef4b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:58.200877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc26df-e59b-4e85-beb7-24be8c7fc495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:58.201727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc26df-e59b-4e85-beb7-24be8c7fc495 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:58.202012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc26df-e59b-4e85-beb7-24be8c7fc495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:58.202281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc26df-e59b-4e85-beb7-24be8c7fc495 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:58.202926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc26df-e59b-4e85-beb7-24be8c7fc495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:58.204893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc26df-e59b-4e85-beb7-24be8c7fc495 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:58.298489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1106/2202] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:22:58 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:22:58.299943 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b905eda-447d-48f5-b749-9535f98e6cbf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:58.311893 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b905eda-447d-48f5-b749-9535f98e6cbf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:58.318286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c7a1e-67f1-42c8-af00-998e0d6a1f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:58.319185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c7a1e-67f1-42c8-af00-998e0d6a1f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:58.319681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c7a1e-67f1-42c8-af00-998e0d6a1f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:58.320026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c7a1e-67f1-42c8-af00-998e0d6a1f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:58.320797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c7a1e-67f1-42c8-af00-998e0d6a1f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:58.322472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c7a1e-67f1-42c8-af00-998e0d6a1f72 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:58.344177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1097/2203] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:22:58.347029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc26df-e59b-4e85-beb7-24be8c7fc495 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:58.358648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc26df-e59b-4e85-beb7-24be8c7fc495 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:58.363734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f783da-ea37-4775-997d-a7df1337ff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:58.364391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f783da-ea37-4775-997d-a7df1337ff74 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:58.364741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f783da-ea37-4775-997d-a7df1337ff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:58.365014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f783da-ea37-4775-997d-a7df1337ff74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:58.365677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f783da-ea37-4775-997d-a7df1337ff74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:58.367266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f783da-ea37-4775-997d-a7df1337ff74 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:58.382309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1107/2204] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:22:58.383578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c7a1e-67f1-42c8-af00-998e0d6a1f72 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:58.394708 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c7a1e-67f1-42c8-af00-998e0d6a1f72 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:58.399403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32cc7a-3a85-4c90-9925-77337499a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:58.400325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32cc7a-3a85-4c90-9925-77337499a7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:58.400607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32cc7a-3a85-4c90-9925-77337499a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:58.401098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32cc7a-3a85-4c90-9925-77337499a7d3 admin admin] PATH_INFO: `/v3/projects/8be25246a1064b2b939770efb0cd5b26/users/26877baf29c74d2d93a30313ea94c775/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:58.422897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32cc7a-3a85-4c90-9925-77337499a7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be25246a1064b2b939770efb0cd5b26, user_id=26877baf29c74d2d93a30313ea94c775, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:58.425655 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32cc7a-3a85-4c90-9925-77337499a7d3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:58.512606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1098/2205] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:22:58 2022] PUT /identity/v3/projects/8be25246a1064b2b939770efb0cd5b26/users/26877baf29c74d2d93a30313ea94c775/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:22:58.520709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd65c0b-05f4-44a4-9f25-53bd8a050a1c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:58.523544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd65c0b-05f4-44a4-9f25-53bd8a050a1c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:58.523544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd65c0b-05f4-44a4-9f25-53bd8a050a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:58.539339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:22:58.546383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8cd65c0b-05f4-44a4-9f25-53bd8a050a1c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:22:58.547648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8cd65c0b-05f4-44a4-9f25-53bd8a050a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:58.619028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1108/2206] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:22:58.630311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32cc7a-3a85-4c90-9925-77337499a7d3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:22:58.632616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de32cc7a-3a85-4c90-9925-77337499a7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:22:58.723560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32cc7a-3a85-4c90-9925-77337499a7d3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:22:58.729641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473872ae-57ad-49ac-a121-cf85bf794e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:22:58.730679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473872ae-57ad-49ac-a121-cf85bf794e93 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:22:58.731672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473872ae-57ad-49ac-a121-cf85bf794e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:22:58.731995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473872ae-57ad-49ac-a121-cf85bf794e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:22:58.743451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473872ae-57ad-49ac-a121-cf85bf794e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:22:58.745231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473872ae-57ad-49ac-a121-cf85bf794e93 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:22:58.756107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1099/2207] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:23:00.626702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7213a1-b24f-4c5e-9d2e-cba8c6b72863 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:00.628171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7213a1-b24f-4c5e-9d2e-cba8c6b72863 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:00.628705 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7213a1-b24f-4c5e-9d2e-cba8c6b72863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:00.655020 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6d7213a1-b24f-4c5e-9d2e-cba8c6b72863 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:00.656716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6d7213a1-b24f-4c5e-9d2e-cba8c6b72863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:00.763160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1109/2208] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:23:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:23:00.807004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473872ae-57ad-49ac-a121-cf85bf794e93 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:00.808596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-473872ae-57ad-49ac-a121-cf85bf794e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:00.922996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141932b-29ad-4a58-ba6a-af3acb1a0a5c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:00.923206 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141932b-29ad-4a58-ba6a-af3acb1a0a5c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:00.923471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141932b-29ad-4a58-ba6a-af3acb1a0a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:00.963057 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:23:00.975063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473872ae-57ad-49ac-a121-cf85bf794e93 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:00.999467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442765d-afdf-4105-83fa-e475a7ec40f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:00.999467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442765d-afdf-4105-83fa-e475a7ec40f1 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:00.999467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442765d-afdf-4105-83fa-e475a7ec40f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:00.999467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442765d-afdf-4105-83fa-e475a7ec40f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:01.013407 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7141932b-29ad-4a58-ba6a-af3acb1a0a5c None None] MFA Rules not processed for user `26877baf29c74d2d93a30313ea94c775`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:01.014676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7141932b-29ad-4a58-ba6a-af3acb1a0a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:01.029087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442765d-afdf-4105-83fa-e475a7ec40f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:01.030694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442765d-afdf-4105-83fa-e475a7ec40f1 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:01.044629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1100/2209] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:23:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:23:01.147489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1110/2210] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:23:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:23:01.159817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442765d-afdf-4105-83fa-e475a7ec40f1 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:01.161346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2442765d-afdf-4105-83fa-e475a7ec40f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:01.248374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442765d-afdf-4105-83fa-e475a7ec40f1 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:01.254154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fba3f5-7c6f-45cc-8a4f-01fc5d20c62f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:01.254785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fba3f5-7c6f-45cc-8a4f-01fc5d20c62f service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:01.255066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fba3f5-7c6f-45cc-8a4f-01fc5d20c62f service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:01.255344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fba3f5-7c6f-45cc-8a4f-01fc5d20c62f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:01.265420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fba3f5-7c6f-45cc-8a4f-01fc5d20c62f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:01.267169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fba3f5-7c6f-45cc-8a4f-01fc5d20c62f service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:01.278449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1101/2211] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:23:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:23:03.169597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f00b4-740a-4539-9f46-0c012ee1d49b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:03.170987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f00b4-740a-4539-9f46-0c012ee1d49b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:03.171434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f00b4-740a-4539-9f46-0c012ee1d49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:03.196896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-549f00b4-740a-4539-9f46-0c012ee1d49b None None] MFA Rules not processed for user `26877baf29c74d2d93a30313ea94c775`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:03.198387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-549f00b4-740a-4539-9f46-0c012ee1d49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:03.224013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1111/2212] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:23:11.273288 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=31 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:23:12.049452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d80149-198c-4adf-a8c2-69b31b3f02f2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:12.049844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d80149-198c-4adf-a8c2-69b31b3f02f2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:12.050428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d80149-198c-4adf-a8c2-69b31b3f02f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:12.075113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e2d80149-198c-4adf-a8c2-69b31b3f02f2 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:12.076462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2d80149-198c-4adf-a8c2-69b31b3f02f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:12.088264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1102/2213] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 1 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:23:12.105162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f00b4-740a-4539-9f46-0c012ee1d49b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:12.117896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f00b4-740a-4539-9f46-0c012ee1d49b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:12.125954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e851b-b980-44f0-bc1f-3477b712e10f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:12.126798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e851b-b980-44f0-bc1f-3477b712e10f service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:12.127071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e851b-b980-44f0-bc1f-3477b712e10f service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:12.127503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e851b-b980-44f0-bc1f-3477b712e10f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:12.136570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e851b-b980-44f0-bc1f-3477b712e10f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:12.138398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e851b-b980-44f0-bc1f-3477b712e10f service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:12.146709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1112/2214] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:23:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:23:14.942598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d80149-198c-4adf-a8c2-69b31b3f02f2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:14.944107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2d80149-198c-4adf-a8c2-69b31b3f02f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:14.955838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d80149-198c-4adf-a8c2-69b31b3f02f2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:14.959709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67935793-667f-41ee-93d8-e49f659503fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:14.964387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935793-667f-41ee-93d8-e49f659503fc service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:14.964387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935793-667f-41ee-93d8-e49f659503fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:14.964387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935793-667f-41ee-93d8-e49f659503fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:14.964387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-67935793-667f-41ee-93d8-e49f659503fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:15.028243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67935793-667f-41ee-93d8-e49f659503fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:15.033095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67935793-667f-41ee-93d8-e49f659503fc service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:15.039157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1103/2215] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:23:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:23:16.628887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e851b-b980-44f0-bc1f-3477b712e10f service swift] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:16.630732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-368e851b-b980-44f0-bc1f-3477b712e10f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:16.650824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e851b-b980-44f0-bc1f-3477b712e10f service swift] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:16.663834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:16.664739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:16.665437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:16.665726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] PATH_INFO: `/v3/users/02738d3604e2453e807e7d563abda982` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:16.667115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=02738d3604e2453e807e7d563abda982)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:16.669989 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:16.701701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:23:16.887721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02738d3604e2453e807e7d563abda982'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:16.899806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02738d3604e2453e807e7d563abda982'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:16.899806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02738d3604e2453e807e7d563abda982'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:16.995697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02738d3604e2453e807e7d563abda982'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:17.010462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-25648af8-aedb-4a94-a9df-2cbf66e8ebbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02738d3604e2453e807e7d563abda982'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:17.016467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1113/2216] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:23:16 2022] DELETE /identity/v3/users/02738d3604e2453e807e7d563abda982 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:23:17.350924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67935793-667f-41ee-93d8-e49f659503fc service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:17.376458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67935793-667f-41ee-93d8-e49f659503fc service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:17.452774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:17.453523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:17.453865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:17.454204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] PATH_INFO: `/v3/projects/76081f2f18a646eb9a2c4edbefcc4ed7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:17.455398 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=76081f2f18a646eb9a2c4edbefcc4ed7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:17.457402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:17.590417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76081f2f18a646eb9a2c4edbefcc4ed7', 'request_id': 'req-881f6000-5e43-432a-b578-f845376764eb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:17.597264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76081f2f18a646eb9a2c4edbefcc4ed7', 'request_id': 'req-881f6000-5e43-432a-b578-f845376764eb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:17.602738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76081f2f18a646eb9a2c4edbefcc4ed7', 'request_id': 'req-881f6000-5e43-432a-b578-f845376764eb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:17.682465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] The token cache is being invalidate because project 76081f2f18a646eb9a2c4edbefcc4ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:23:17.682827 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:17.683822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-881f6000-5e43-432a-b578-f845376764eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:17.689072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1104/2217] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:23:17 2022] DELETE /identity/v3/projects/76081f2f18a646eb9a2c4edbefcc4ed7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:23:17.690648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570b95-0ae2-473e-9f76-6baee6822ea5 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:17.691138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570b95-0ae2-473e-9f76-6baee6822ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:17.691275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570b95-0ae2-473e-9f76-6baee6822ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:17.712197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6f570b95-0ae2-473e-9f76-6baee6822ea5 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:17.713440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6f570b95-0ae2-473e-9f76-6baee6822ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:17.775669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1114/2218] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:23:17.841966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3a46-5b0a-41b0-ad7f-b7c17971d224 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:17.842173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3a46-5b0a-41b0-ad7f-b7c17971d224 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:17.842423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3a46-5b0a-41b0-ad7f-b7c17971d224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:17.862738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-896b3a46-5b0a-41b0-ad7f-b7c17971d224 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:17.864065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-896b3a46-5b0a-41b0-ad7f-b7c17971d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:17.873200 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1105/2219] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:23:17.877537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570b95-0ae2-473e-9f76-6baee6822ea5 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:17.888503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570b95-0ae2-473e-9f76-6baee6822ea5 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:17.893624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e459bd-864b-4b9a-81ea-a640c20c819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:17.894332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e459bd-864b-4b9a-81ea-a640c20c819a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:17.894611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e459bd-864b-4b9a-81ea-a640c20c819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:17.894885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e459bd-864b-4b9a-81ea-a640c20c819a admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:17.895692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e459bd-864b-4b9a-81ea-a640c20c819a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:23:17.896005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e459bd-864b-4b9a-81ea-a640c20c819a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:17.897642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e459bd-864b-4b9a-81ea-a640c20c819a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:17.909844 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1115/2220] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:23:17.914197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b3a46-5b0a-41b0-ad7f-b7c17971d224 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:17.924082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b3a46-5b0a-41b0-ad7f-b7c17971d224 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:17.928708 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e6985-13ba-4416-8187-3d87819e1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:17.929400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e6985-13ba-4416-8187-3d87819e1052 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:17.929624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e6985-13ba-4416-8187-3d87819e1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:17.929899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e6985-13ba-4416-8187-3d87819e1052 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:17.930576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e6985-13ba-4416-8187-3d87819e1052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:17.932648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e6985-13ba-4416-8187-3d87819e1052 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:17.942860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:23:18.024304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1106/2221] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:23:17 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:23:18.025883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e459bd-864b-4b9a-81ea-a640c20c819a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:18.039223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e459bd-864b-4b9a-81ea-a640c20c819a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:18.105007 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcb96c-ee87-45d9-aada-12968c5ffd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:18.105754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcb96c-ee87-45d9-aada-12968c5ffd65 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:18.106113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcb96c-ee87-45d9-aada-12968c5ffd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:18.106481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcb96c-ee87-45d9-aada-12968c5ffd65 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:18.107742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcb96c-ee87-45d9-aada-12968c5ffd65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:18.110246 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcb96c-ee87-45d9-aada-12968c5ffd65 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:18.221598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1116/2222] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:23:18 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:23:18.223215 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e6985-13ba-4416-8187-3d87819e1052 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:18.233996 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e6985-13ba-4416-8187-3d87819e1052 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:18.238908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1352678-ba9c-48c5-9803-8f89f5d1620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:18.239593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1352678-ba9c-48c5-9803-8f89f5d1620e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:18.239949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1352678-ba9c-48c5-9803-8f89f5d1620e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:18.240340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1352678-ba9c-48c5-9803-8f89f5d1620e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:18.241184 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1352678-ba9c-48c5-9803-8f89f5d1620e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:18.242980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1352678-ba9c-48c5-9803-8f89f5d1620e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:18.254567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1107/2223] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:23:18.265173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcb96c-ee87-45d9-aada-12968c5ffd65 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:18.275188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcb96c-ee87-45d9-aada-12968c5ffd65 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:18.279868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ff47b-d38a-489d-b9fe-7c7976fd5661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:18.280523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ff47b-d38a-489d-b9fe-7c7976fd5661 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:18.281175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ff47b-d38a-489d-b9fe-7c7976fd5661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:18.281175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ff47b-d38a-489d-b9fe-7c7976fd5661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:18.281708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ff47b-d38a-489d-b9fe-7c7976fd5661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:18.283292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ff47b-d38a-489d-b9fe-7c7976fd5661 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:18.288541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:23:18.296738 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1117/2224] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:23:18.311647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1352678-ba9c-48c5-9803-8f89f5d1620e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:18.322151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1352678-ba9c-48c5-9803-8f89f5d1620e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:18.326946 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c4d27-cac4-4cbb-8e43-5eeafaa6e566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:18.327593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c4d27-cac4-4cbb-8e43-5eeafaa6e566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:18.327873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c4d27-cac4-4cbb-8e43-5eeafaa6e566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:18.328176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c4d27-cac4-4cbb-8e43-5eeafaa6e566 admin admin] PATH_INFO: `/v3/projects/6cc37dccc7f84087bec1203d6aec2416/users/6d3cc556264c424db616390d2ef6a662/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:18.343101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c4d27-cac4-4cbb-8e43-5eeafaa6e566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc37dccc7f84087bec1203d6aec2416, user_id=6d3cc556264c424db616390d2ef6a662, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:18.354164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c4d27-cac4-4cbb-8e43-5eeafaa6e566 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:18.523297 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1108/2225] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:23:18 2022] PUT /identity/v3/projects/6cc37dccc7f84087bec1203d6aec2416/users/6d3cc556264c424db616390d2ef6a662/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:23:18.533402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067d887-0663-4972-a0a6-b3a5ce280661 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:18.533782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067d887-0663-4972-a0a6-b3a5ce280661 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:18.534149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067d887-0663-4972-a0a6-b3a5ce280661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:18.566325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a067d887-0663-4972-a0a6-b3a5ce280661 None None] MFA Rules not processed for user `6d3cc556264c424db616390d2ef6a662`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:18.567586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a067d887-0663-4972-a0a6-b3a5ce280661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:18.644203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1118/2226] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:23:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:23:18.652616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c4d27-cac4-4cbb-8e43-5eeafaa6e566 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:18.654825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dc4c4d27-cac4-4cbb-8e43-5eeafaa6e566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:18.728088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c4d27-cac4-4cbb-8e43-5eeafaa6e566 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:18.732840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df073c60-faeb-4542-a242-771386cac8b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:18.733405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df073c60-faeb-4542-a242-771386cac8b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:18.733688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df073c60-faeb-4542-a242-771386cac8b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:18.733967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df073c60-faeb-4542-a242-771386cac8b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:18.743429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df073c60-faeb-4542-a242-771386cac8b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:18.745028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df073c60-faeb-4542-a242-771386cac8b9 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:18.755682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1109/2227] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:23:22.395263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed428f-2786-457f-a726-0d6fa3df0472 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:22.395813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed428f-2786-457f-a726-0d6fa3df0472 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:22.395908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed428f-2786-457f-a726-0d6fa3df0472 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:22.397264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1119/2228] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:23:22.403779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62963af9-be2a-45f9-9028-cb26e9687f19 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:22.404465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62963af9-be2a-45f9-9028-cb26e9687f19 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:22.404465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62963af9-be2a-45f9-9028-cb26e9687f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:22.424323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-62963af9-be2a-45f9-9028-cb26e9687f19 None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:22.425525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-62963af9-be2a-45f9-9028-cb26e9687f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:22.501827 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1110/2229] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:23:22.514340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed428f-2786-457f-a726-0d6fa3df0472 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:22.516006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-59ed428f-2786-457f-a726-0d6fa3df0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:22.573428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed428f-2786-457f-a726-0d6fa3df0472 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:22.577629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42c2bb-5500-427f-959f-49febb1a669a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b84587baf0432c800a6278d7095cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:22.578275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42c2bb-5500-427f-959f-49febb1a669a service glance] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:22.578537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42c2bb-5500-427f-959f-49febb1a669a service glance] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:22.578809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42c2bb-5500-427f-959f-49febb1a669a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:22.588891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42c2bb-5500-427f-959f-49febb1a669a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:22.590316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42c2bb-5500-427f-959f-49febb1a669a service glance] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:22.601175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1120/2230] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:23:22.814308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094802-a898-4d70-83e0-2e78f44b0036 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:22.814669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094802-a898-4d70-83e0-2e78f44b0036 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:22.814882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094802-a898-4d70-83e0-2e78f44b0036 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:22.816381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1111/2231] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:23:22.821285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55e361-37ed-4f5e-9679-1a15da96bbf8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:22.821564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55e361-37ed-4f5e-9679-1a15da96bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:22.821845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55e361-37ed-4f5e-9679-1a15da96bbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:22.841503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fa55e361-37ed-4f5e-9679-1a15da96bbf8 None None] MFA Rules not processed for user `d0eb27228bae4b6d97715c0c46032030`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:22.842733 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fa55e361-37ed-4f5e-9679-1a15da96bbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:22.897900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1121/2232] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:23:22.910535 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d094802-a898-4d70-83e0-2e78f44b0036 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:22.912634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d094802-a898-4d70-83e0-2e78f44b0036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:22.926924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d094802-a898-4d70-83e0-2e78f44b0036 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:22.930723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c746a2-7387-45ce-83c3-368dc2a97128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:22.931409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c746a2-7387-45ce-83c3-368dc2a97128 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:22.931760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c746a2-7387-45ce-83c3-368dc2a97128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:22.932098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c746a2-7387-45ce-83c3-368dc2a97128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:22.936710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55e361-37ed-4f5e-9679-1a15da96bbf8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:22.942140 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c746a2-7387-45ce-83c3-368dc2a97128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:22.944476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c746a2-7387-45ce-83c3-368dc2a97128 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:22.953616 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1112/2233] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:23:22.989967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:23:23.012302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55e361-37ed-4f5e-9679-1a15da96bbf8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:23.017656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:23.018298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:23.018684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:23.018971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] PATH_INFO: `/v3/users/6d3cc556264c424db616390d2ef6a662` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:23.020344 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d3cc556264c424db616390d2ef6a662)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:23.024089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:23.041460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0cfa-b71d-4d96-8579-65f4e6e49e76 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:23.041751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0cfa-b71d-4d96-8579-65f4e6e49e76 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:23.042032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0cfa-b71d-4d96-8579-65f4e6e49e76 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:23.043403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1113/2234] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:23:23.049228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91052dd-44d5-4677-bd9e-1c3a65b30851 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:23.049512 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91052dd-44d5-4677-bd9e-1c3a65b30851 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:23.049790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91052dd-44d5-4677-bd9e-1c3a65b30851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:23.069955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f91052dd-44d5-4677-bd9e-1c3a65b30851 None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:23.071308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f91052dd-44d5-4677-bd9e-1c3a65b30851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:23.084117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1114/2235] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:23:23.095537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91052dd-44d5-4677-bd9e-1c3a65b30851 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:23.105551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91052dd-44d5-4677-bd9e-1c3a65b30851 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:23.110019 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2e33d-d56a-4471-b745-f28f8c508473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:23.115872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e33d-d56a-4471-b745-f28f8c508473 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:23.115872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e33d-d56a-4471-b745-f28f8c508473 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:23.115872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e33d-d56a-4471-b745-f28f8c508473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:23.121540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2e33d-d56a-4471-b745-f28f8c508473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:23.123280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2e33d-d56a-4471-b745-f28f8c508473 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:23.134046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1115/2236] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:23:23.205987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d3cc556264c424db616390d2ef6a662'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:23.213386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d3cc556264c424db616390d2ef6a662'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:23.214092 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d3cc556264c424db616390d2ef6a662'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:23.303435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d3cc556264c424db616390d2ef6a662'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:23.316910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d3cc556264c424db616390d2ef6a662'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:23.323058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1122/2237] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:23:22 2022] DELETE /identity/v3/users/6d3cc556264c424db616390d2ef6a662 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:23:23.328913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb770-a207-4841-86ad-31a69793bfef None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:23.329235 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb770-a207-4841-86ad-31a69793bfef None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:23.329640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb770-a207-4841-86ad-31a69793bfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:23.349255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-98fcb770-a207-4841-86ad-31a69793bfef None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:23.350495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-98fcb770-a207-4841-86ad-31a69793bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:23.361055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:23:23.410397 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1116/2238] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:23:23.420662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:23.422296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:23.482582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9a61d-f981-4a64-915c-b1e5759f06d8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:23.486285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cde8d-8702-44db-a4d3-baeec11b6bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:23.486887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cde8d-8702-44db-a4d3-baeec11b6bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:23.487158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cde8d-8702-44db-a4d3-baeec11b6bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:23.487435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cde8d-8702-44db-a4d3-baeec11b6bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:23.497124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cde8d-8702-44db-a4d3-baeec11b6bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:23.500295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cde8d-8702-44db-a4d3-baeec11b6bd2 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:23.514506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1123/2239] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:23:24.007459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcb770-a207-4841-86ad-31a69793bfef None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:24.008971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-98fcb770-a207-4841-86ad-31a69793bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:24.021963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcb770-a207-4841-86ad-31a69793bfef None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:24.026718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:24.027353 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:24.027632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:24.027899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] PATH_INFO: `/v3/projects/6cc37dccc7f84087bec1203d6aec2416` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:24.029314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc37dccc7f84087bec1203d6aec2416)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:24.031303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:24.151141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc37dccc7f84087bec1203d6aec2416', 'request_id': 'req-606d7a37-bd47-44dd-9ddf-e0778a568cd0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:24.161818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc37dccc7f84087bec1203d6aec2416', 'request_id': 'req-606d7a37-bd47-44dd-9ddf-e0778a568cd0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:24.167484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc37dccc7f84087bec1203d6aec2416', 'request_id': 'req-606d7a37-bd47-44dd-9ddf-e0778a568cd0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:24.252351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] The token cache is being invalidate because project 6cc37dccc7f84087bec1203d6aec2416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:23:24.252582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:24.253211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:23:24.254737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1117/2240] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:23:24 2022] DELETE /identity/v3/projects/6cc37dccc7f84087bec1203d6aec2416 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:23:27.327255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed7b4-2b0d-4b34-b08c-27a6923e11b4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:27.327745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed7b4-2b0d-4b34-b08c-27a6923e11b4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:27.327861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed7b4-2b0d-4b34-b08c-27a6923e11b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:27.347740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-eaaed7b4-2b0d-4b34-b08c-27a6923e11b4 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:27.349116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-eaaed7b4-2b0d-4b34-b08c-27a6923e11b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:27.415841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1124/2241] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:23:27.428723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:27.430406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:27.503473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d7a37-bd47-44dd-9ddf-e0778a568cd0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:27.508800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3946cc-c223-4c71-9269-afb26d16c67b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:27.509521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3946cc-c223-4c71-9269-afb26d16c67b service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:27.509916 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3946cc-c223-4c71-9269-afb26d16c67b service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:27.510289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3946cc-c223-4c71-9269-afb26d16c67b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:27.519843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3946cc-c223-4c71-9269-afb26d16c67b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:27.521457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3946cc-c223-4c71-9269-afb26d16c67b service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:27.530270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1118/2242] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:23:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:23:37.408578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:23:37.532451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:23:53.908453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0ab90-2a15-4ecd-8f56-7963f02081ec None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:53.908943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0ab90-2a15-4ecd-8f56-7963f02081ec None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:53.909057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0ab90-2a15-4ecd-8f56-7963f02081ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:53.928743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e0c0ab90-2a15-4ecd-8f56-7963f02081ec None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:23:53.929943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e0c0ab90-2a15-4ecd-8f56-7963f02081ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:23:53.936999 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1125/2243] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 1 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:23:53.960428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3946cc-c223-4c71-9269-afb26d16c67b service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:23:53.971578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3946cc-c223-4c71-9269-afb26d16c67b service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:23:53.977034 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf629ab-3e72-40e9-b31e-7f17a808cefe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:23:53.977924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf629ab-3e72-40e9-b31e-7f17a808cefe service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:23:53.978154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf629ab-3e72-40e9-b31e-7f17a808cefe service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:23:53.978427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf629ab-3e72-40e9-b31e-7f17a808cefe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:23:53.987312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf629ab-3e72-40e9-b31e-7f17a808cefe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:23:53.989034 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf629ab-3e72-40e9-b31e-7f17a808cefe service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:23:53.999837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1119/2244] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:23:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:24:03.923065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:24:03.996344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:24:15.612421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0ab90-2a15-4ecd-8f56-7963f02081ec None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:15.613722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e0c0ab90-2a15-4ecd-8f56-7963f02081ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:15.669986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0ab90-2a15-4ecd-8f56-7963f02081ec None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:15.673700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017c053-5270-4dda-b809-a69d90f6c945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:15.674301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017c053-5270-4dda-b809-a69d90f6c945 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:15.674578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017c053-5270-4dda-b809-a69d90f6c945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:15.674848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017c053-5270-4dda-b809-a69d90f6c945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:15.676624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d017c053-5270-4dda-b809-a69d90f6c945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:15.750746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017c053-5270-4dda-b809-a69d90f6c945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:15.752175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017c053-5270-4dda-b809-a69d90f6c945 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:15.763730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1126/2245] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:15.976420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deec511-afeb-41f4-95cf-fcf205fdc0c8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:15.976922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deec511-afeb-41f4-95cf-fcf205fdc0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:15.977033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deec511-afeb-41f4-95cf-fcf205fdc0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:15.997981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6deec511-afeb-41f4-95cf-fcf205fdc0c8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:24:15.999202 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6deec511-afeb-41f4-95cf-fcf205fdc0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:16.057606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1120/2246] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:24:16.079437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017c053-5270-4dda-b809-a69d90f6c945 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:16.080830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d017c053-5270-4dda-b809-a69d90f6c945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:16.094102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017c053-5270-4dda-b809-a69d90f6c945 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:16.099502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e29a6-bfab-402c-8770-33560ae61a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:16.100092 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e29a6-bfab-402c-8770-33560ae61a70 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:16.100399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e29a6-bfab-402c-8770-33560ae61a70 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:16.100674 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e29a6-bfab-402c-8770-33560ae61a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:16.109055 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e29a6-bfab-402c-8770-33560ae61a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:16.110594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e29a6-bfab-402c-8770-33560ae61a70 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:16.120437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1127/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:18.104290 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deec511-afeb-41f4-95cf-fcf205fdc0c8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:18.113861 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deec511-afeb-41f4-95cf-fcf205fdc0c8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:18.117449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c705f2-8185-47a3-ae99-ffd126b65533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:18.118016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c705f2-8185-47a3-ae99-ffd126b65533 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:18.118296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c705f2-8185-47a3-ae99-ffd126b65533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:18.118573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c705f2-8185-47a3-ae99-ffd126b65533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:18.120803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d1c705f2-8185-47a3-ae99-ffd126b65533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:18.134068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c705f2-8185-47a3-ae99-ffd126b65533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:18.136180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c705f2-8185-47a3-ae99-ffd126b65533 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:18.146993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1121/2248] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:20.614352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f165d-9cad-421c-ad5b-81809f36d92f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:20.614864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f165d-9cad-421c-ad5b-81809f36d92f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:20.614972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f165d-9cad-421c-ad5b-81809f36d92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:20.633837 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e38f165d-9cad-421c-ad5b-81809f36d92f None None] MFA Rules not processed for user `2e9410daf1b242f8ba5ed06e8d4556d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:24:20.637998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e38f165d-9cad-421c-ad5b-81809f36d92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:20.691126 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1128/2249] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:24:22.359691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daf99e-e419-447f-b899-99918cd4e65e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:22.360279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daf99e-e419-447f-b899-99918cd4e65e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:22.360279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daf99e-e419-447f-b899-99918cd4e65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:22.380283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-21daf99e-e419-447f-b899-99918cd4e65e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:24:22.381513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-21daf99e-e419-447f-b899-99918cd4e65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:22.390618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1122/2250] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:24:22.413945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f165d-9cad-421c-ad5b-81809f36d92f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:22.415348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e38f165d-9cad-421c-ad5b-81809f36d92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:22.430628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f165d-9cad-421c-ad5b-81809f36d92f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:22.436879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d6fc0-bde4-4316-9c80-3d0d38cb84ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:22.437824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d6fc0-bde4-4316-9c80-3d0d38cb84ea service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:22.438104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d6fc0-bde4-4316-9c80-3d0d38cb84ea service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:22.438392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d6fc0-bde4-4316-9c80-3d0d38cb84ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:22.456764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d6fc0-bde4-4316-9c80-3d0d38cb84ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:22.458391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d6fc0-bde4-4316-9c80-3d0d38cb84ea service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:22.469499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1129/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:24:30.077324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a4499-437f-46a4-b923-8920587a34ea None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:30.077818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a4499-437f-46a4-b923-8920587a34ea None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:30.078281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a4499-437f-46a4-b923-8920587a34ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:30.099100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e78a4499-437f-46a4-b923-8920587a34ea None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:24:30.100249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e78a4499-437f-46a4-b923-8920587a34ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:30.108709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1123/2252] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:24:30.130099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d6fc0-bde4-4316-9c80-3d0d38cb84ea service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:30.142210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d6fc0-bde4-4316-9c80-3d0d38cb84ea service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:30.149172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881d4e8-1171-40f3-9b94-b26a2b9eb3c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:30.149766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881d4e8-1171-40f3-9b94-b26a2b9eb3c1 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:30.150042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881d4e8-1171-40f3-9b94-b26a2b9eb3c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:30.151009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881d4e8-1171-40f3-9b94-b26a2b9eb3c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:30.158481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881d4e8-1171-40f3-9b94-b26a2b9eb3c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:30.160039 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881d4e8-1171-40f3-9b94-b26a2b9eb3c1 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:30.169885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1130/2253] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:32.334658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a4499-437f-46a4-b923-8920587a34ea None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:32.347524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a4499-437f-46a4-b923-8920587a34ea None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:32.352844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c27949-d971-46a7-a902-0feb3cbd710a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:32.353452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c27949-d971-46a7-a902-0feb3cbd710a service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:32.353728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c27949-d971-46a7-a902-0feb3cbd710a service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:32.353999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c27949-d971-46a7-a902-0feb3cbd710a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:32.355692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d6c27949-d971-46a7-a902-0feb3cbd710a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:32.411981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c27949-d971-46a7-a902-0feb3cbd710a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:32.413578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c27949-d971-46a7-a902-0feb3cbd710a service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:32.423003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1124/2254] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:33.961822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd323bac-3131-4beb-b2dc-0b34d7316721 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:33.962314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd323bac-3131-4beb-b2dc-0b34d7316721 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:33.962432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd323bac-3131-4beb-b2dc-0b34d7316721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:33.976943 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:24:33.982323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fd323bac-3131-4beb-b2dc-0b34d7316721 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:24:33.983506 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fd323bac-3131-4beb-b2dc-0b34d7316721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:33.991453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1131/2255] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:24:34.012891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c27949-d971-46a7-a902-0feb3cbd710a service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:34.024316 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c27949-d971-46a7-a902-0feb3cbd710a service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:34.030590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc1a0-15bb-44c5-bee8-fdebc23b39fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:34.031187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc1a0-15bb-44c5-bee8-fdebc23b39fb service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:34.031464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc1a0-15bb-44c5-bee8-fdebc23b39fb service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:34.031737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc1a0-15bb-44c5-bee8-fdebc23b39fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:34.039818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc1a0-15bb-44c5-bee8-fdebc23b39fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:34.041406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc1a0-15bb-44c5-bee8-fdebc23b39fb service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:34.050568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1125/2256] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:39.253417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329747a8-1678-46e6-b71c-6d0c3e5c2de5 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:39.253992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329747a8-1678-46e6-b71c-6d0c3e5c2de5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:39.253992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329747a8-1678-46e6-b71c-6d0c3e5c2de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:39.273239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-329747a8-1678-46e6-b71c-6d0c3e5c2de5 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:24:39.274446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-329747a8-1678-46e6-b71c-6d0c3e5c2de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:39.282295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1132/2257] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:24:39.305859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc1a0-15bb-44c5-bee8-fdebc23b39fb service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:39.317750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc1a0-15bb-44c5-bee8-fdebc23b39fb service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:39.323137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeda77-f090-4f98-b9b0-c481ebcbfa43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:39.323724 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeda77-f090-4f98-b9b0-c481ebcbfa43 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:39.324033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeda77-f090-4f98-b9b0-c481ebcbfa43 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:39.324345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeda77-f090-4f98-b9b0-c481ebcbfa43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:39.332416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeda77-f090-4f98-b9b0-c481ebcbfa43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:39.333993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeda77-f090-4f98-b9b0-c481ebcbfa43 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:39.343304 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1126/2258] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:44.576817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779574-9254-40a2-897e-f9e54f772c04 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:44.577329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779574-9254-40a2-897e-f9e54f772c04 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:44.577434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779574-9254-40a2-897e-f9e54f772c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:44.596717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-01779574-9254-40a2-897e-f9e54f772c04 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:24:44.597932 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-01779574-9254-40a2-897e-f9e54f772c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:44.606094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1133/2259] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:24:44.632805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeda77-f090-4f98-b9b0-c481ebcbfa43 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:44.638612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=80 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:24:44.644688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeda77-f090-4f98-b9b0-c481ebcbfa43 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:44.650204 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77738df3-db95-4935-bb78-598f1a9c2ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:44.650981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738df3-db95-4935-bb78-598f1a9c2ea2 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:44.651186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738df3-db95-4935-bb78-598f1a9c2ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:44.651366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738df3-db95-4935-bb78-598f1a9c2ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:44.659783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77738df3-db95-4935-bb78-598f1a9c2ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:44.661406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77738df3-db95-4935-bb78-598f1a9c2ea2 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:44.671134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1127/2260] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:47.649631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779574-9254-40a2-897e-f9e54f772c04 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:47.651136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-01779574-9254-40a2-897e-f9e54f772c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:47.663588 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779574-9254-40a2-897e-f9e54f772c04 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:47.668303 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb45b7f-edd1-4ac9-84ee-a34a933ff19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:47.668929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb45b7f-edd1-4ac9-84ee-a34a933ff19c service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:47.669228 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb45b7f-edd1-4ac9-84ee-a34a933ff19c service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:47.669491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb45b7f-edd1-4ac9-84ee-a34a933ff19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:47.671278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bcb45b7f-edd1-4ac9-84ee-a34a933ff19c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:47.681431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb45b7f-edd1-4ac9-84ee-a34a933ff19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:47.683362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb45b7f-edd1-4ac9-84ee-a34a933ff19c service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:47.691363 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1134/2261] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:52.966156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77738df3-db95-4935-bb78-598f1a9c2ea2 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:52.977519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77738df3-db95-4935-bb78-598f1a9c2ea2 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:52.982961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03921f-794a-4349-acba-f65c006c9d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:52.983542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03921f-794a-4349-acba-f65c006c9d65 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:52.983819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03921f-794a-4349-acba-f65c006c9d65 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:52.984092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03921f-794a-4349-acba-f65c006c9d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:52.985825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8e03921f-794a-4349-acba-f65c006c9d65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:53.043810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03921f-794a-4349-acba-f65c006c9d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:53.045412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03921f-794a-4349-acba-f65c006c9d65 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:53.054389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1128/2262] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:57.687122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=12 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:24:58.895887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb45b7f-edd1-4ac9-84ee-a34a933ff19c service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:58.910133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb45b7f-edd1-4ac9-84ee-a34a933ff19c service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:58.915976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309a557-4687-4743-946e-bd51e72596bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:58.916861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a557-4687-4743-946e-bd51e72596bf service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:58.917139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a557-4687-4743-946e-bd51e72596bf service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:58.917410 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a557-4687-4743-946e-bd51e72596bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:58.919280 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d309a557-4687-4743-946e-bd51e72596bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:58.932902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309a557-4687-4743-946e-bd51e72596bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:58.934768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309a557-4687-4743-946e-bd51e72596bf service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:58.945965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1135/2263] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:24:59.439116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03921f-794a-4349-acba-f65c006c9d65 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:24:59.454340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03921f-794a-4349-acba-f65c006c9d65 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:24:59.461295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953ebdc-9be9-4804-adc3-2f203254d830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:24:59.462106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ebdc-9be9-4804-adc3-2f203254d830 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:24:59.462492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ebdc-9be9-4804-adc3-2f203254d830 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:24:59.462873 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ebdc-9be9-4804-adc3-2f203254d830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:24:59.465021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7953ebdc-9be9-4804-adc3-2f203254d830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:24:59.482445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953ebdc-9be9-4804-adc3-2f203254d830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:24:59.484924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953ebdc-9be9-4804-adc3-2f203254d830 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:24:59.506048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1129/2264] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:24:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:05.337193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00150497-8768-486c-8f26-af64b36e8933 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:05.337694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00150497-8768-486c-8f26-af64b36e8933 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:05.337794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00150497-8768-486c-8f26-af64b36e8933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:05.356628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-00150497-8768-486c-8f26-af64b36e8933 None None] MFA Rules not processed for user `26877baf29c74d2d93a30313ea94c775`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:25:05.357882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-00150497-8768-486c-8f26-af64b36e8933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:05.413245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1136/2265] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:25:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:25:05.706511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953ebdc-9be9-4804-adc3-2f203254d830 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:05.715932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953ebdc-9be9-4804-adc3-2f203254d830 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:05.719659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc81f9-49e9-4e85-924e-105fa27d079c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:05.720372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc81f9-49e9-4e85-924e-105fa27d079c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:05.720714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc81f9-49e9-4e85-924e-105fa27d079c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:05.721493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc81f9-49e9-4e85-924e-105fa27d079c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:05.723327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-79bc81f9-49e9-4e85-924e-105fa27d079c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:05.733346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc81f9-49e9-4e85-924e-105fa27d079c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:05.734810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc81f9-49e9-4e85-924e-105fa27d079c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:05.743265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1130/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:06.148624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00150497-8768-486c-8f26-af64b36e8933 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:06.150028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-00150497-8768-486c-8f26-af64b36e8933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:06.220786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00150497-8768-486c-8f26-af64b36e8933 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:06.226551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b6f7e-3276-47a1-86ff-030d8e5f5199 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:06.227161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b6f7e-3276-47a1-86ff-030d8e5f5199 service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:06.227444 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b6f7e-3276-47a1-86ff-030d8e5f5199 service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:06.227723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b6f7e-3276-47a1-86ff-030d8e5f5199 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:06.229481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-eb1b6f7e-3276-47a1-86ff-030d8e5f5199 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:06.240771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b6f7e-3276-47a1-86ff-030d8e5f5199 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:06.242332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b6f7e-3276-47a1-86ff-030d8e5f5199 service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:06.252161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1137/2267] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:12.681348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc81f9-49e9-4e85-924e-105fa27d079c service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:12.694323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc81f9-49e9-4e85-924e-105fa27d079c service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:12.699736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266a750-9d90-441f-828f-b3c857567259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:12.700386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266a750-9d90-441f-828f-b3c857567259 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:12.700662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266a750-9d90-441f-828f-b3c857567259 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:12.700931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266a750-9d90-441f-828f-b3c857567259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:12.702621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e266a750-9d90-441f-828f-b3c857567259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:12.761776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266a750-9d90-441f-828f-b3c857567259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:12.763545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266a750-9d90-441f-828f-b3c857567259 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:12.774452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1131/2268] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:14.669812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ceb1-0bf3-46a4-bddb-ae7150aa1d1c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:14.670276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ceb1-0bf3-46a4-bddb-ae7150aa1d1c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:14.670384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ceb1-0bf3-46a4-bddb-ae7150aa1d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:14.690266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-18a8ceb1-0bf3-46a4-bddb-ae7150aa1d1c None None] MFA Rules not processed for user `7699159c5e67464ba6b82ec848c24439`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:25:14.694218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-18a8ceb1-0bf3-46a4-bddb-ae7150aa1d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:14.698505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1138/2269] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:25:17.966783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266a750-9d90-441f-828f-b3c857567259 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:17.972742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=74 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:25:17.980842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266a750-9d90-441f-828f-b3c857567259 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:17.987048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c0ee-7524-40e3-90ea-9b434655d78d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:17.987767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c0ee-7524-40e3-90ea-9b434655d78d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:17.992385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c0ee-7524-40e3-90ea-9b434655d78d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:17.992385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c0ee-7524-40e3-90ea-9b434655d78d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:17.992385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ab7c0ee-7524-40e3-90ea-9b434655d78d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:18.006337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7c0ee-7524-40e3-90ea-9b434655d78d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:18.008283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7c0ee-7524-40e3-90ea-9b434655d78d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:18.020203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1132/2270] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:24.684628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=66 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:25:26.297480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c1b9-6534-4582-859b-c9e692c8ca83 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:26.298086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c1b9-6534-4582-859b-c9e692c8ca83 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:26.298086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c1b9-6534-4582-859b-c9e692c8ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:26.317040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6259c1b9-6534-4582-859b-c9e692c8ca83 None None] MFA Rules not processed for user `a51ee88d16004507aa9d199782ced8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:25:26.318242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6259c1b9-6534-4582-859b-c9e692c8ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:26.325623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1139/2271] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:25:26.522408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c0ee-7524-40e3-90ea-9b434655d78d service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:26.523807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ab7c0ee-7524-40e3-90ea-9b434655d78d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:26.579972 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c0ee-7524-40e3-90ea-9b434655d78d service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:26.584119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3b2d-0676-41db-998f-f2ab571e5113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:26.584779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3b2d-0676-41db-998f-f2ab571e5113 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:26.585060 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3b2d-0676-41db-998f-f2ab571e5113 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:26.585337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3b2d-0676-41db-998f-f2ab571e5113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:26.587114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-746d3b2d-0676-41db-998f-f2ab571e5113 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:26.599024 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3b2d-0676-41db-998f-f2ab571e5113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:26.600586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d3b2d-0676-41db-998f-f2ab571e5113 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:26.610478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1133/2272] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:26.634600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259c1b9-6534-4582-859b-c9e692c8ca83 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:26.644264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259c1b9-6534-4582-859b-c9e692c8ca83 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:26.648498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddeb886-3708-495a-a125-4094d005ab26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:26.649099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddeb886-3708-495a-a125-4094d005ab26 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:26.649377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddeb886-3708-495a-a125-4094d005ab26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:26.649648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddeb886-3708-495a-a125-4094d005ab26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:26.651338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4ddeb886-3708-495a-a125-4094d005ab26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:26.661665 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddeb886-3708-495a-a125-4094d005ab26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:26.663296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddeb886-3708-495a-a125-4094d005ab26 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:26.671713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1140/2273] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:29.073009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471898d-6d3e-473e-8d35-8f85c3c63e38 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:29.073501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471898d-6d3e-473e-8d35-8f85c3c63e38 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:29.073719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471898d-6d3e-473e-8d35-8f85c3c63e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:29.093872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2471898d-6d3e-473e-8d35-8f85c3c63e38 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:25:29.095324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2471898d-6d3e-473e-8d35-8f85c3c63e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:29.103379 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1134/2274] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:25:29.124234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddeb886-3708-495a-a125-4094d005ab26 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:29.137551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddeb886-3708-495a-a125-4094d005ab26 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:29.143006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35186c59-9027-4d35-a56b-18684008dd3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:29.143600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35186c59-9027-4d35-a56b-18684008dd3a service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:29.143878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35186c59-9027-4d35-a56b-18684008dd3a service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:29.144152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35186c59-9027-4d35-a56b-18684008dd3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:29.152851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35186c59-9027-4d35-a56b-18684008dd3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:29.154412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35186c59-9027-4d35-a56b-18684008dd3a service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:29.163646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1141/2275] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:36.768603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c99a3-71d6-41d8-88e1-23e6ecf72937 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:36.769702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c99a3-71d6-41d8-88e1-23e6ecf72937 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:36.770146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c99a3-71d6-41d8-88e1-23e6ecf72937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:36.795523 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9a7c99a3-71d6-41d8-88e1-23e6ecf72937 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:25:36.796901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9a7c99a3-71d6-41d8-88e1-23e6ecf72937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:36.809356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1135/2276] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:25:36.829707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35186c59-9027-4d35-a56b-18684008dd3a service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:36.847217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35186c59-9027-4d35-a56b-18684008dd3a service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:36.856143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe3480-3408-4534-b5e4-77f068e5a3b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:36.857081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe3480-3408-4534-b5e4-77f068e5a3b4 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:36.857597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe3480-3408-4534-b5e4-77f068e5a3b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:36.858091 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe3480-3408-4534-b5e4-77f068e5a3b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:36.871992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe3480-3408-4534-b5e4-77f068e5a3b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:36.873648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe3480-3408-4534-b5e4-77f068e5a3b4 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:36.885954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1142/2277] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:40.737922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1284f9-d31d-476f-94df-64cb9f68ba5b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:40.738978 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1284f9-d31d-476f-94df-64cb9f68ba5b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:40.738978 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1284f9-d31d-476f-94df-64cb9f68ba5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:40.759425 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1d1284f9-d31d-476f-94df-64cb9f68ba5b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:25:40.760582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d1284f9-d31d-476f-94df-64cb9f68ba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:40.768590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1136/2278] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:25:40.797019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe3480-3408-4534-b5e4-77f068e5a3b4 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:40.808559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe3480-3408-4534-b5e4-77f068e5a3b4 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:40.814047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8c867-47f8-4d8b-8abb-c83e5ab1cc00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:40.814637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8c867-47f8-4d8b-8abb-c83e5ab1cc00 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:40.814918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8c867-47f8-4d8b-8abb-c83e5ab1cc00 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:40.815192 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8c867-47f8-4d8b-8abb-c83e5ab1cc00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:40.823751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8c867-47f8-4d8b-8abb-c83e5ab1cc00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:40.825337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8c867-47f8-4d8b-8abb-c83e5ab1cc00 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:40.834566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1143/2279] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:48.099278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38745-8693-46bb-97f4-6fad548f00ce None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:48.099805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38745-8693-46bb-97f4-6fad548f00ce None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:48.099916 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38745-8693-46bb-97f4-6fad548f00ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:48.107700 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=41 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:25:48.120472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6af38745-8693-46bb-97f4-6fad548f00ce None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:25:48.121923 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6af38745-8693-46bb-97f4-6fad548f00ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:48.130424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1137/2280] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:25:48.156656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8c867-47f8-4d8b-8abb-c83e5ab1cc00 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:48.167678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8c867-47f8-4d8b-8abb-c83e5ab1cc00 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:48.174906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3d612-092b-4b74-a592-e00cd994f3f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:48.180330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d612-092b-4b74-a592-e00cd994f3f6 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:48.180330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d612-092b-4b74-a592-e00cd994f3f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:48.180330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d612-092b-4b74-a592-e00cd994f3f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:48.185243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3d612-092b-4b74-a592-e00cd994f3f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:48.186846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3d612-092b-4b74-a592-e00cd994f3f6 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:48.197411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1144/2281] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:25:53.373061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dec57b-297f-42b3-baf7-8e7795325c2e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:53.373642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dec57b-297f-42b3-baf7-8e7795325c2e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:53.373738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dec57b-297f-42b3-baf7-8e7795325c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:53.394637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b8dec57b-297f-42b3-baf7-8e7795325c2e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:25:53.395848 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b8dec57b-297f-42b3-baf7-8e7795325c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:25:53.404545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1138/2282] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Sep 1 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:25:53.430701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3d612-092b-4b74-a592-e00cd994f3f6 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:25:53.443125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3d612-092b-4b74-a592-e00cd994f3f6 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:25:53.448776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11452d71-2595-4aeb-82c5-5f28b3079886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:25:53.449383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11452d71-2595-4aeb-82c5-5f28b3079886 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:25:53.449665 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11452d71-2595-4aeb-82c5-5f28b3079886 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:25:53.449945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11452d71-2595-4aeb-82c5-5f28b3079886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:25:53.458844 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11452d71-2595-4aeb-82c5-5f28b3079886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:25:53.460458 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11452d71-2595-4aeb-82c5-5f28b3079886 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:25:53.470521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1145/2283] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:00.562599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dec57b-297f-42b3-baf7-8e7795325c2e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:00.573371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dec57b-297f-42b3-baf7-8e7795325c2e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:00.584713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f3a4a-7707-4fe0-8163-19e3ad73bf66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:00.584713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f3a4a-7707-4fe0-8163-19e3ad73bf66 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:00.584713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f3a4a-7707-4fe0-8163-19e3ad73bf66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:00.584713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f3a4a-7707-4fe0-8163-19e3ad73bf66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:00.585401 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-526f3a4a-7707-4fe0-8163-19e3ad73bf66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:00.592876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f3a4a-7707-4fe0-8163-19e3ad73bf66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:00.594285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f3a4a-7707-4fe0-8163-19e3ad73bf66 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:00.603817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1139/2284] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:02.605370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50151d5b-5bd8-4ce0-b256-8fc7e3d5d035 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:02.605864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50151d5b-5bd8-4ce0-b256-8fc7e3d5d035 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:02.605992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50151d5b-5bd8-4ce0-b256-8fc7e3d5d035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:02.613216 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=40 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:02.626542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-50151d5b-5bd8-4ce0-b256-8fc7e3d5d035 None None] MFA Rules not processed for user `b66719801f8e4c56a7fc0208704d538f`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:02.627808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-50151d5b-5bd8-4ce0-b256-8fc7e3d5d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:02.636442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1146/2285] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:04.901161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f3a4a-7707-4fe0-8163-19e3ad73bf66 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:04.902575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-526f3a4a-7707-4fe0-8163-19e3ad73bf66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:04.919584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f3a4a-7707-4fe0-8163-19e3ad73bf66 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:04.925536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11fdca-43c6-488f-bcaf-9ee9bba90e3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:04.926171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11fdca-43c6-488f-bcaf-9ee9bba90e3c service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:04.926445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11fdca-43c6-488f-bcaf-9ee9bba90e3c service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:04.926720 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11fdca-43c6-488f-bcaf-9ee9bba90e3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:04.929363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-df11fdca-43c6-488f-bcaf-9ee9bba90e3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:04.941268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11fdca-43c6-488f-bcaf-9ee9bba90e3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:04.945805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11fdca-43c6-488f-bcaf-9ee9bba90e3c service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:04.952707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1140/2286] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:05.073547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50151d5b-5bd8-4ce0-b256-8fc7e3d5d035 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:05.076097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-50151d5b-5bd8-4ce0-b256-8fc7e3d5d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:05.090238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50151d5b-5bd8-4ce0-b256-8fc7e3d5d035 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:05.095681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:05.096313 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:05.096641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:05.096917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] PATH_INFO: `/v3/users/2e9410daf1b242f8ba5ed06e8d4556d6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:05.101281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9410daf1b242f8ba5ed06e8d4556d6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:05.103259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:05.267704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9410daf1b242f8ba5ed06e8d4556d6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:05.274965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9410daf1b242f8ba5ed06e8d4556d6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:05.275645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9410daf1b242f8ba5ed06e8d4556d6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:05.346221 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9410daf1b242f8ba5ed06e8d4556d6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:05.359568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-94df50e6-bccc-42b1-b418-6fe57f319e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9410daf1b242f8ba5ed06e8d4556d6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:05.365676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1147/2287] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:26:05 2022] DELETE /identity/v3/users/2e9410daf1b242f8ba5ed06e8d4556d6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:05.596016 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11fdca-43c6-488f-bcaf-9ee9bba90e3c service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:05.608928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11fdca-43c6-488f-bcaf-9ee9bba90e3c service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:05.674803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:05.675444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:05.675719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:05.675991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] PATH_INFO: `/v3/projects/0f820b1379fb4d6ab182ea9ce923c27b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:05.677262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f820b1379fb4d6ab182ea9ce923c27b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:05.679198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:05.791069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f820b1379fb4d6ab182ea9ce923c27b', 'request_id': 'req-be9c7cb4-83ba-47ba-a8c6-b248f7350883'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:05.797098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f820b1379fb4d6ab182ea9ce923c27b', 'request_id': 'req-be9c7cb4-83ba-47ba-a8c6-b248f7350883'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:05.802590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f820b1379fb4d6ab182ea9ce923c27b', 'request_id': 'req-be9c7cb4-83ba-47ba-a8c6-b248f7350883'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:05.876976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] The token cache is being invalidate because project 0f820b1379fb4d6ab182ea9ce923c27b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:26:05.877270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:05.882218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-be9c7cb4-83ba-47ba-a8c6-b248f7350883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:05.882218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1141/2288] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:26:05 2022] DELETE /identity/v3/projects/0f820b1379fb4d6ab182ea9ce923c27b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:05.884877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb364-2922-493c-b24c-33198726d7c2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:05.885189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb364-2922-493c-b24c-33198726d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:05.885453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb364-2922-493c-b24c-33198726d7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:05.905786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7bbbb364-2922-493c-b24c-33198726d7c2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:05.906983 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7bbbb364-2922-493c-b24c-33198726d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:05.964695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1148/2289] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:26:05.972603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0fd17-a01e-46c1-8189-b93f3577f1cd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:05.973062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0fd17-a01e-46c1-8189-b93f3577f1cd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:05.973252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0fd17-a01e-46c1-8189-b93f3577f1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:05.993048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-afe0fd17-a01e-46c1-8189-b93f3577f1cd None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:05.994242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-afe0fd17-a01e-46c1-8189-b93f3577f1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:06.002382 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1142/2290] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:06.007097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbb364-2922-493c-b24c-33198726d7c2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:06.016671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbb364-2922-493c-b24c-33198726d7c2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:06.021234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60f48f-c60c-4ddc-9dc7-eb66dbc127a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:06.021824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60f48f-c60c-4ddc-9dc7-eb66dbc127a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:06.022133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60f48f-c60c-4ddc-9dc7-eb66dbc127a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:06.022409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60f48f-c60c-4ddc-9dc7-eb66dbc127a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:06.023056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60f48f-c60c-4ddc-9dc7-eb66dbc127a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:26:06.023361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60f48f-c60c-4ddc-9dc7-eb66dbc127a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:06.025004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60f48f-c60c-4ddc-9dc7-eb66dbc127a9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:06.036301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1149/2291] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:26:06.040561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0fd17-a01e-46c1-8189-b93f3577f1cd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:06.049572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0fd17-a01e-46c1-8189-b93f3577f1cd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:06.054887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3a99e-74a9-476d-866f-2cbaf44adcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:06.055477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3a99e-74a9-476d-866f-2cbaf44adcc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:06.055751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3a99e-74a9-476d-866f-2cbaf44adcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:06.056023 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3a99e-74a9-476d-866f-2cbaf44adcc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:06.056683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3a99e-74a9-476d-866f-2cbaf44adcc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:06.058589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3a99e-74a9-476d-866f-2cbaf44adcc8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:06.147922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1143/2292] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:26:06 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:06.152071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60f48f-c60c-4ddc-9dc7-eb66dbc127a9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:06.162059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60f48f-c60c-4ddc-9dc7-eb66dbc127a9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:06.212699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:06.219428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcffc76-bed6-4b57-8568-5d5d35ae58bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:06.220033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcffc76-bed6-4b57-8568-5d5d35ae58bd admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:06.223838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcffc76-bed6-4b57-8568-5d5d35ae58bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:06.223838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcffc76-bed6-4b57-8568-5d5d35ae58bd admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:06.223838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcffc76-bed6-4b57-8568-5d5d35ae58bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:06.223838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcffc76-bed6-4b57-8568-5d5d35ae58bd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:06.306952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1150/2293] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:26:06 2022] POST /identity/v3/users => generated 278 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:06.311287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3a99e-74a9-476d-866f-2cbaf44adcc8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:06.324719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3a99e-74a9-476d-866f-2cbaf44adcc8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:06.330009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8429f-eb7a-4ef7-a143-808db8488789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:06.330860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8429f-eb7a-4ef7-a143-808db8488789 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:06.331141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8429f-eb7a-4ef7-a143-808db8488789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:06.331417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8429f-eb7a-4ef7-a143-808db8488789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:06.332071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8429f-eb7a-4ef7-a143-808db8488789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:06.333863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8429f-eb7a-4ef7-a143-808db8488789 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:06.344643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1144/2294] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:26:06.351070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcffc76-bed6-4b57-8568-5d5d35ae58bd admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:06.372180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcffc76-bed6-4b57-8568-5d5d35ae58bd admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:06.377070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3677f-5d1a-4257-9421-75591c66ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:06.377669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3677f-5d1a-4257-9421-75591c66ddc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:06.377945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3677f-5d1a-4257-9421-75591c66ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:06.378216 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3677f-5d1a-4257-9421-75591c66ddc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:06.378856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3677f-5d1a-4257-9421-75591c66ddc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:06.380472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3677f-5d1a-4257-9421-75591c66ddc4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:06.391002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1151/2295] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:06.395357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8429f-eb7a-4ef7-a143-808db8488789 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:06.405458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8429f-eb7a-4ef7-a143-808db8488789 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:06.410281 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd108073-f418-44d0-a325-87db65275ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:06.410963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108073-f418-44d0-a325-87db65275ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:06.411783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108073-f418-44d0-a325-87db65275ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:06.412060 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108073-f418-44d0-a325-87db65275ebb admin admin] PATH_INFO: `/v3/projects/48015da941ed4226a195ff61804b1370/users/fc2c22cd06e541d185fb22fe5a7d4e15/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:06.423187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:06.427593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd108073-f418-44d0-a325-87db65275ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=48015da941ed4226a195ff61804b1370, user_id=fc2c22cd06e541d185fb22fe5a7d4e15, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:06.430271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd108073-f418-44d0-a325-87db65275ebb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:06.495027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1145/2296] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:06 2022] PUT /identity/v3/projects/48015da941ed4226a195ff61804b1370/users/fc2c22cd06e541d185fb22fe5a7d4e15/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:06.506228 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6f674-734a-4ff0-a3f1-893425a83571 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:06.506519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6f674-734a-4ff0-a3f1-893425a83571 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:06.506802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6f674-734a-4ff0-a3f1-893425a83571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:06.534692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ade6f674-734a-4ff0-a3f1-893425a83571 None None] MFA Rules not processed for user `fc2c22cd06e541d185fb22fe5a7d4e15`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:06.535971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ade6f674-734a-4ff0-a3f1-893425a83571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:06.599296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1152/2297] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:06.603852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd108073-f418-44d0-a325-87db65275ebb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:06.665444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd108073-f418-44d0-a325-87db65275ebb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:06.670065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38425-741d-4e5d-a8b5-e985ef28adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:06.670671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38425-741d-4e5d-a8b5-e985ef28adab admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:06.670957 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38425-741d-4e5d-a8b5-e985ef28adab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:06.671232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38425-741d-4e5d-a8b5-e985ef28adab admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:06.671878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b38425-741d-4e5d-a8b5-e985ef28adab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:06.673821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b38425-741d-4e5d-a8b5-e985ef28adab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:06.759600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1146/2298] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:26:06 2022] POST /identity/v3/projects => generated 357 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:06.763524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6f674-734a-4ff0-a3f1-893425a83571 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:06.774854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6f674-734a-4ff0-a3f1-893425a83571 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:06.835703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202fa45-8d6c-4316-a7ab-e0ff09feb98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:06.836359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202fa45-8d6c-4316-a7ab-e0ff09feb98e admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:06.836695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202fa45-8d6c-4316-a7ab-e0ff09feb98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:06.836990 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202fa45-8d6c-4316-a7ab-e0ff09feb98e admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:06.837689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202fa45-8d6c-4316-a7ab-e0ff09feb98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:06.839970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202fa45-8d6c-4316-a7ab-e0ff09feb98e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:07.158244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1153/2299] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:26:06 2022] POST /identity/v3/users => generated 285 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:07.162356 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38425-741d-4e5d-a8b5-e985ef28adab admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:07.172860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38425-741d-4e5d-a8b5-e985ef28adab admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:07.181004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc27f3-7bb6-45b1-810f-850fa76548a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:07.181004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc27f3-7bb6-45b1-810f-850fa76548a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:07.181004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc27f3-7bb6-45b1-810f-850fa76548a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:07.181004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc27f3-7bb6-45b1-810f-850fa76548a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:07.181601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc27f3-7bb6-45b1-810f-850fa76548a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:07.181703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc27f3-7bb6-45b1-810f-850fa76548a4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:07.193714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1147/2300] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:26:07.198184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202fa45-8d6c-4316-a7ab-e0ff09feb98e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:07.209345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202fa45-8d6c-4316-a7ab-e0ff09feb98e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:07.215269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a32f0f-0d41-4106-90d1-038f99324b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:07.215269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a32f0f-0d41-4106-90d1-038f99324b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:07.215269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a32f0f-0d41-4106-90d1-038f99324b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:07.215793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a32f0f-0d41-4106-90d1-038f99324b53 admin admin] PATH_INFO: `/v3/projects/02645d8aa5f94f32aa2df9f87c4dc23f/users/be5e78d459b4422e893c15d938743b10/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:07.230700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a32f0f-0d41-4106-90d1-038f99324b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02645d8aa5f94f32aa2df9f87c4dc23f, user_id=be5e78d459b4422e893c15d938743b10, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:07.233586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a32f0f-0d41-4106-90d1-038f99324b53 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:07.324081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1154/2301] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:07 2022] PUT /identity/v3/projects/02645d8aa5f94f32aa2df9f87c4dc23f/users/be5e78d459b4422e893c15d938743b10/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:07.328240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc27f3-7bb6-45b1-810f-850fa76548a4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:07.338987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc27f3-7bb6-45b1-810f-850fa76548a4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:07.394828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dbb1a-6681-433b-895c-72cbb1c2ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:07.395444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dbb1a-6681-433b-895c-72cbb1c2ec21 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:07.395726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dbb1a-6681-433b-895c-72cbb1c2ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:07.396622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dbb1a-6681-433b-895c-72cbb1c2ec21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:07.397272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dbb1a-6681-433b-895c-72cbb1c2ec21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:07.398920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dbb1a-6681-433b-895c-72cbb1c2ec21 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:07.408913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1148/2302] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:07.413190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a32f0f-0d41-4106-90d1-038f99324b53 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:07.423308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a32f0f-0d41-4106-90d1-038f99324b53 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:07.428550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5d7cf-04dd-457b-b486-4770a4d44862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:07.429226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5d7cf-04dd-457b-b486-4770a4d44862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:07.429517 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5d7cf-04dd-457b-b486-4770a4d44862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:07.429764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5d7cf-04dd-457b-b486-4770a4d44862 admin admin] PATH_INFO: `/v3/projects/02645d8aa5f94f32aa2df9f87c4dc23f/users/be5e78d459b4422e893c15d938743b10/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:07.431704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5d7cf-04dd-457b-b486-4770a4d44862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02645d8aa5f94f32aa2df9f87c4dc23f, user_id=be5e78d459b4422e893c15d938743b10, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:07.434370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5d7cf-04dd-457b-b486-4770a4d44862 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:07.449330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1155/2303] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:07 2022] PUT /identity/v3/projects/02645d8aa5f94f32aa2df9f87c4dc23f/users/be5e78d459b4422e893c15d938743b10/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:07.459751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97867f49-ebea-4454-a3ce-65d4ccfe92f7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:07.460042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97867f49-ebea-4454-a3ce-65d4ccfe92f7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:07.460349 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97867f49-ebea-4454-a3ce-65d4ccfe92f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:07.488436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-97867f49-ebea-4454-a3ce-65d4ccfe92f7 None None] MFA Rules not processed for user `be5e78d459b4422e893c15d938743b10`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:07.490792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-97867f49-ebea-4454-a3ce-65d4ccfe92f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:07.539053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:07.561248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1149/2304] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:07.573585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5d7cf-04dd-457b-b486-4770a4d44862 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:07.575249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-88f5d7cf-04dd-457b-b486-4770a4d44862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:07.596023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:07.656512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5d7cf-04dd-457b-b486-4770a4d44862 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:07.661465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def32af0-37e3-46e3-a732-da3ae4e67440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:07.661465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def32af0-37e3-46e3-a732-da3ae4e67440 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:07.661465 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def32af0-37e3-46e3-a732-da3ae4e67440 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:07.661853 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def32af0-37e3-46e3-a732-da3ae4e67440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:07.671707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def32af0-37e3-46e3-a732-da3ae4e67440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:07.673306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def32af0-37e3-46e3-a732-da3ae4e67440 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:07.688648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1156/2305] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:07.937678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97867f49-ebea-4454-a3ce-65d4ccfe92f7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:07.947374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97867f49-ebea-4454-a3ce-65d4ccfe92f7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:07.951139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82669142-d991-4a8c-a9c2-e28870555cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:07.951760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82669142-d991-4a8c-a9c2-e28870555cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:07.952039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82669142-d991-4a8c-a9c2-e28870555cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:07.952351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82669142-d991-4a8c-a9c2-e28870555cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:08.008955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82669142-d991-4a8c-a9c2-e28870555cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:08.010374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82669142-d991-4a8c-a9c2-e28870555cb4 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:08.019753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1150/2306] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:17.683518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=19 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:18.015163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=35 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:25.498544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51e6aa-9ebc-47d8-9cba-9fc53c0b165e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:25.503641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51e6aa-9ebc-47d8-9cba-9fc53c0b165e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:25.503641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51e6aa-9ebc-47d8-9cba-9fc53c0b165e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:25.503641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1157/2307] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:26:25.506991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f08a1d-cef8-4f19-a3bb-1f07a0657b16 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:25.507459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f08a1d-cef8-4f19-a3bb-1f07a0657b16 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:25.507648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f08a1d-cef8-4f19-a3bb-1f07a0657b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:25.546930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a1f08a1d-cef8-4f19-a3bb-1f07a0657b16 None None] MFA Rules not processed for user `d0eb27228bae4b6d97715c0c46032030`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:25.548441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a1f08a1d-cef8-4f19-a3bb-1f07a0657b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:25.609681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1151/2308] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:26:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:25.622650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51e6aa-9ebc-47d8-9cba-9fc53c0b165e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:25.626494 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4d51e6aa-9ebc-47d8-9cba-9fc53c0b165e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:25.638400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51e6aa-9ebc-47d8-9cba-9fc53c0b165e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:25.642059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ac40a-7376-47b2-85ff-20bc14909e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:25.642651 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ac40a-7376-47b2-85ff-20bc14909e22 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:25.642930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ac40a-7376-47b2-85ff-20bc14909e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:25.643198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ac40a-7376-47b2-85ff-20bc14909e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:25.650966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ac40a-7376-47b2-85ff-20bc14909e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:25.652416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ac40a-7376-47b2-85ff-20bc14909e22 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:25.660328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1158/2309] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:26:25.744573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5592b-67f9-4ed5-a5ec-e817abed3aeb None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:25.744896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5592b-67f9-4ed5-a5ec-e817abed3aeb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:25.745219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5592b-67f9-4ed5-a5ec-e817abed3aeb None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:25.746863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1152/2310] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:26:25.752559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde90e6-30ae-4351-82e9-c155c69f6955 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:25.752847 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde90e6-30ae-4351-82e9-c155c69f6955 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:25.753154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde90e6-30ae-4351-82e9-c155c69f6955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:25.772699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bfde90e6-30ae-4351-82e9-c155c69f6955 None None] MFA Rules not processed for user `7790d6ec0e524ee6a31fd06fda9c4ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:25.773994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bfde90e6-30ae-4351-82e9-c155c69f6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:25.841533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1159/2311] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:26:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:25.851930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5592b-67f9-4ed5-a5ec-e817abed3aeb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:25.863291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5592b-67f9-4ed5-a5ec-e817abed3aeb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:25.866967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008170f3-2e98-4e81-84f5-eb813ee015f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:25.867558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008170f3-2e98-4e81-84f5-eb813ee015f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:25.867835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008170f3-2e98-4e81-84f5-eb813ee015f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:25.868107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008170f3-2e98-4e81-84f5-eb813ee015f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:25.879062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008170f3-2e98-4e81-84f5-eb813ee015f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:25.880572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008170f3-2e98-4e81-84f5-eb813ee015f1 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:25.891688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1153/2312] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:28.123404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde90e6-30ae-4351-82e9-c155c69f6955 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:28.199460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde90e6-30ae-4351-82e9-c155c69f6955 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:28.203960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:28.204626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:28.204903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:28.205175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] PATH_INFO: `/v3/users/fc2c22cd06e541d185fb22fe5a7d4e15` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:28.206314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2c22cd06e541d185fb22fe5a7d4e15)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:28.208302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:28.422440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2c22cd06e541d185fb22fe5a7d4e15'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:28.429245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2c22cd06e541d185fb22fe5a7d4e15'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:28.429906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2c22cd06e541d185fb22fe5a7d4e15'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:28.488497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2c22cd06e541d185fb22fe5a7d4e15'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:28.501160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2c22cd06e541d185fb22fe5a7d4e15'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:28.502613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:28.507709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1160/2313] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:26:28 2022] DELETE /identity/v3/users/fc2c22cd06e541d185fb22fe5a7d4e15 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:28.512409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffa78a-1aad-4466-87d0-5461e65a6b86 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:28.512895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffa78a-1aad-4466-87d0-5461e65a6b86 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:28.513014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffa78a-1aad-4466-87d0-5461e65a6b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:28.532567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-71ffa78a-1aad-4466-87d0-5461e65a6b86 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:28.533881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-71ffa78a-1aad-4466-87d0-5461e65a6b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:28.592684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1154/2314] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:28.602318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:28.603730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:28.665747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ca146-9ff4-499b-99c5-8144f6879cb4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:28.669545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2187fb-e222-4844-bcdc-12031e52cc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:28.670161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2187fb-e222-4844-bcdc-12031e52cc43 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:28.674087 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2187fb-e222-4844-bcdc-12031e52cc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:28.674087 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2187fb-e222-4844-bcdc-12031e52cc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:28.679910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2187fb-e222-4844-bcdc-12031e52cc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:28.681428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2187fb-e222-4844-bcdc-12031e52cc43 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:28.692786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1161/2315] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:29.305298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffa78a-1aad-4466-87d0-5461e65a6b86 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:29.308530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-71ffa78a-1aad-4466-87d0-5461e65a6b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:29.321346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffa78a-1aad-4466-87d0-5461e65a6b86 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:29.328429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:29.329178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:29.330599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:29.331110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] PATH_INFO: `/v3/projects/48015da941ed4226a195ff61804b1370` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:29.332769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48015da941ed4226a195ff61804b1370)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:29.334926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:29.501839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48015da941ed4226a195ff61804b1370', 'request_id': 'req-f175dd30-55a3-4141-8ca0-a2a45acc4784'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:29.508007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48015da941ed4226a195ff61804b1370', 'request_id': 'req-f175dd30-55a3-4141-8ca0-a2a45acc4784'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:29.513686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48015da941ed4226a195ff61804b1370', 'request_id': 'req-f175dd30-55a3-4141-8ca0-a2a45acc4784'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:29.606340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] The token cache is being invalidate because project 48015da941ed4226a195ff61804b1370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:26:29.606643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:29.607621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:29.609406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1155/2316] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:26:29 2022] DELETE /identity/v3/projects/48015da941ed4226a195ff61804b1370 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:29.613216 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2187fb-e222-4844-bcdc-12031e52cc43 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:29.623681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2187fb-e222-4844-bcdc-12031e52cc43 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:29.679935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:29.680601 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:29.680884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:29.681159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] PATH_INFO: `/v3/users/be5e78d459b4422e893c15d938743b10` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:29.686031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5e78d459b4422e893c15d938743b10)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:29.688356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:29.845770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5e78d459b4422e893c15d938743b10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:29.852701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5e78d459b4422e893c15d938743b10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:29.853404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5e78d459b4422e893c15d938743b10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:29.980286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5e78d459b4422e893c15d938743b10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:29.993295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-033ef1c2-b3d1-49e0-94c2-10699e9c8b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5e78d459b4422e893c15d938743b10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:29.999516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1162/2317] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:26:29 2022] DELETE /identity/v3/users/be5e78d459b4422e893c15d938743b10 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:30.416385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:30.418232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:30.432598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175dd30-55a3-4141-8ca0-a2a45acc4784 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:30.452341 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:30.492241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:30.492885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:30.493168 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:30.493442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] PATH_INFO: `/v3/projects/02645d8aa5f94f32aa2df9f87c4dc23f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:30.494565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02645d8aa5f94f32aa2df9f87c4dc23f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:30.497327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:30.614796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02645d8aa5f94f32aa2df9f87c4dc23f', 'request_id': 'req-d0e2cfe9-fe3f-4a7b-ae29-654938430694'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:30.620962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02645d8aa5f94f32aa2df9f87c4dc23f', 'request_id': 'req-d0e2cfe9-fe3f-4a7b-ae29-654938430694'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:30.626960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02645d8aa5f94f32aa2df9f87c4dc23f', 'request_id': 'req-d0e2cfe9-fe3f-4a7b-ae29-654938430694'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:30.717231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] The token cache is being invalidate because project 02645d8aa5f94f32aa2df9f87c4dc23f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:26:30.717536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:30.718126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d0e2cfe9-fe3f-4a7b-ae29-654938430694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:30.719636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1156/2318] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:26:30 2022] DELETE /identity/v3/projects/02645d8aa5f94f32aa2df9f87c4dc23f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:30.724554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc609d29-9d5c-4d6a-8d7b-e5084297e579 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:30.725037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc609d29-9d5c-4d6a-8d7b-e5084297e579 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:30.725133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc609d29-9d5c-4d6a-8d7b-e5084297e579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:30.744950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bc609d29-9d5c-4d6a-8d7b-e5084297e579 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:30.746893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bc609d29-9d5c-4d6a-8d7b-e5084297e579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:30.759723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:30.805486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1163/2319] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:30.815619 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6fe1-2283-48ba-bcc1-c29ee2bb5853 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:30.815923 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6fe1-2283-48ba-bcc1-c29ee2bb5853 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:30.816198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6fe1-2283-48ba-bcc1-c29ee2bb5853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:30.836905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5d9f6fe1-2283-48ba-bcc1-c29ee2bb5853 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:30.838094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5d9f6fe1-2283-48ba-bcc1-c29ee2bb5853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:30.846633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1157/2320] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:30.857424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc609d29-9d5c-4d6a-8d7b-e5084297e579 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:30.866888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc609d29-9d5c-4d6a-8d7b-e5084297e579 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:30.872184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d3a57-6e34-44a1-b362-191fd5fab68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:30.872874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d3a57-6e34-44a1-b362-191fd5fab68f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:30.873063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d3a57-6e34-44a1-b362-191fd5fab68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:30.873404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d3a57-6e34-44a1-b362-191fd5fab68f admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:30.874052 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d3a57-6e34-44a1-b362-191fd5fab68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:26:30.874349 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d3a57-6e34-44a1-b362-191fd5fab68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:30.875927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d3a57-6e34-44a1-b362-191fd5fab68f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:30.887831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1164/2321] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:26:30.892300 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f6fe1-2283-48ba-bcc1-c29ee2bb5853 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:30.901604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f6fe1-2283-48ba-bcc1-c29ee2bb5853 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:30.906345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a691b-08ec-44d9-a993-2da59978801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:30.906934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a691b-08ec-44d9-a993-2da59978801d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:30.907209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a691b-08ec-44d9-a993-2da59978801d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:30.907480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a691b-08ec-44d9-a993-2da59978801d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:30.908113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a691b-08ec-44d9-a993-2da59978801d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:30.910032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a691b-08ec-44d9-a993-2da59978801d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:31.009596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1158/2322] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:26:30 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:31.010717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d3a57-6e34-44a1-b362-191fd5fab68f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:31.020614 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d3a57-6e34-44a1-b362-191fd5fab68f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:31.075621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d75c6c-bc2b-4242-bc4b-5b2b2b7ff17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:31.076243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d75c6c-bc2b-4242-bc4b-5b2b2b7ff17b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:31.076587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d75c6c-bc2b-4242-bc4b-5b2b2b7ff17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:31.076861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d75c6c-bc2b-4242-bc4b-5b2b2b7ff17b admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:31.077481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d75c6c-bc2b-4242-bc4b-5b2b2b7ff17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:31.079380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d75c6c-bc2b-4242-bc4b-5b2b2b7ff17b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:31.174232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1165/2323] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:26:31 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:31.178417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a691b-08ec-44d9-a993-2da59978801d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:31.189331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a691b-08ec-44d9-a993-2da59978801d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:31.193915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a2cad-2de7-4097-9001-d498cc51d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:31.194507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a2cad-2de7-4097-9001-d498cc51d18c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:31.194787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a2cad-2de7-4097-9001-d498cc51d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:31.195061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a2cad-2de7-4097-9001-d498cc51d18c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:31.195772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a2cad-2de7-4097-9001-d498cc51d18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:31.197397 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a2cad-2de7-4097-9001-d498cc51d18c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:31.207457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1159/2324] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:31.211575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d75c6c-bc2b-4242-bc4b-5b2b2b7ff17b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:31.221719 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d75c6c-bc2b-4242-bc4b-5b2b2b7ff17b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:31.226418 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ef24b-dde0-44bf-9b99-eca1612cc9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:31.227003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef24b-dde0-44bf-9b99-eca1612cc9aa admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:31.227279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef24b-dde0-44bf-9b99-eca1612cc9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:31.227552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef24b-dde0-44bf-9b99-eca1612cc9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:31.228190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ef24b-dde0-44bf-9b99-eca1612cc9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:31.229789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ef24b-dde0-44bf-9b99-eca1612cc9aa admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:31.240644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1166/2325] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:31.246996 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a2cad-2de7-4097-9001-d498cc51d18c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:31.256730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a2cad-2de7-4097-9001-d498cc51d18c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:31.261447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564bf6d-7aa7-4ca2-b57f-e86ee0aca2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:31.262083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564bf6d-7aa7-4ca2-b57f-e86ee0aca2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:31.262364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564bf6d-7aa7-4ca2-b57f-e86ee0aca2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:31.262640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564bf6d-7aa7-4ca2-b57f-e86ee0aca2d0 admin admin] PATH_INFO: `/v3/projects/0226420014e946b5844f90d80848075a/users/def6051f2b1e404b85bd78d41aee41bc/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:31.277151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564bf6d-7aa7-4ca2-b57f-e86ee0aca2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0226420014e946b5844f90d80848075a, user_id=def6051f2b1e404b85bd78d41aee41bc, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:31.280504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564bf6d-7aa7-4ca2-b57f-e86ee0aca2d0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:31.357451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1160/2326] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:31 2022] PUT /identity/v3/projects/0226420014e946b5844f90d80848075a/users/def6051f2b1e404b85bd78d41aee41bc/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:31.369680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a53bb9-2dda-4c27-8eb0-e74c26e934c4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:31.369964 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a53bb9-2dda-4c27-8eb0-e74c26e934c4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:31.370237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a53bb9-2dda-4c27-8eb0-e74c26e934c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:31.397778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c6a53bb9-2dda-4c27-8eb0-e74c26e934c4 None None] MFA Rules not processed for user `def6051f2b1e404b85bd78d41aee41bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:31.398974 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c6a53bb9-2dda-4c27-8eb0-e74c26e934c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:31.463677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1167/2327] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:31.468759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564bf6d-7aa7-4ca2-b57f-e86ee0aca2d0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:31.518280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:31.533470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564bf6d-7aa7-4ca2-b57f-e86ee0aca2d0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:31.537841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40596b-7b48-45ec-8879-53bffa2df7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:31.538448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40596b-7b48-45ec-8879-53bffa2df7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:31.538729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40596b-7b48-45ec-8879-53bffa2df7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:31.539003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40596b-7b48-45ec-8879-53bffa2df7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:31.539656 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40596b-7b48-45ec-8879-53bffa2df7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:31.541590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40596b-7b48-45ec-8879-53bffa2df7c8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:31.615491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1161/2328] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:26:31 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:31.620313 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a53bb9-2dda-4c27-8eb0-e74c26e934c4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:31.631350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a53bb9-2dda-4c27-8eb0-e74c26e934c4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:31.643824 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:31.688415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78c898-3700-4b05-8db5-b273774d06d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:31.689024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c898-3700-4b05-8db5-b273774d06d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:31.689301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c898-3700-4b05-8db5-b273774d06d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:31.689598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c898-3700-4b05-8db5-b273774d06d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:31.690241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78c898-3700-4b05-8db5-b273774d06d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:31.692137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78c898-3700-4b05-8db5-b273774d06d3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:31.833463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1168/2329] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:26:31 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:31.837376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40596b-7b48-45ec-8879-53bffa2df7c8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:31.848573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40596b-7b48-45ec-8879-53bffa2df7c8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:31.853161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bc14-be35-4aa1-a9fa-ea8a90b80fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:31.853754 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bc14-be35-4aa1-a9fa-ea8a90b80fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:31.854037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bc14-be35-4aa1-a9fa-ea8a90b80fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:31.854315 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bc14-be35-4aa1-a9fa-ea8a90b80fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:31.854960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016bc14-be35-4aa1-a9fa-ea8a90b80fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:31.856626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016bc14-be35-4aa1-a9fa-ea8a90b80fbf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:31.866757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1162/2330] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:26:31.873998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78c898-3700-4b05-8db5-b273774d06d3 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:31.883761 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78c898-3700-4b05-8db5-b273774d06d3 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:31.889121 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bf306-6845-48de-9011-05260cf7e55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:31.889768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bf306-6845-48de-9011-05260cf7e55c admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:31.890054 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bf306-6845-48de-9011-05260cf7e55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:31.890323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bf306-6845-48de-9011-05260cf7e55c admin admin] PATH_INFO: `/v3/projects/3aff04f4481a4b67a8fce26638143e00/users/1aa4e938159d4074a4aa65b7ef2dc76f/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:31.905801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bf306-6845-48de-9011-05260cf7e55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aff04f4481a4b67a8fce26638143e00, user_id=1aa4e938159d4074a4aa65b7ef2dc76f, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:31.908471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bf306-6845-48de-9011-05260cf7e55c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:32.026329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1169/2331] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:31 2022] PUT /identity/v3/projects/3aff04f4481a4b67a8fce26638143e00/users/1aa4e938159d4074a4aa65b7ef2dc76f/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:32.030396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bc14-be35-4aa1-a9fa-ea8a90b80fbf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:32.041369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bc14-be35-4aa1-a9fa-ea8a90b80fbf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:32.099956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051d354-c4bd-4b77-b8dd-f5db64f487e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:32.100524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051d354-c4bd-4b77-b8dd-f5db64f487e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:32.100857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051d354-c4bd-4b77-b8dd-f5db64f487e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:32.101134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051d354-c4bd-4b77-b8dd-f5db64f487e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:32.101802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051d354-c4bd-4b77-b8dd-f5db64f487e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:32.103452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051d354-c4bd-4b77-b8dd-f5db64f487e3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:32.113230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1163/2332] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:26:32.117380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bf306-6845-48de-9011-05260cf7e55c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:32.128306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bf306-6845-48de-9011-05260cf7e55c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:32.133173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d03a5e-aee9-447f-8d54-f630cb7a9f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:32.133851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d03a5e-aee9-447f-8d54-f630cb7a9f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:32.134135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d03a5e-aee9-447f-8d54-f630cb7a9f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:32.134411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d03a5e-aee9-447f-8d54-f630cb7a9f78 admin admin] PATH_INFO: `/v3/projects/3aff04f4481a4b67a8fce26638143e00/users/1aa4e938159d4074a4aa65b7ef2dc76f/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:32.136374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d03a5e-aee9-447f-8d54-f630cb7a9f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aff04f4481a4b67a8fce26638143e00, user_id=1aa4e938159d4074a4aa65b7ef2dc76f, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:32.139679 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d03a5e-aee9-447f-8d54-f630cb7a9f78 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:32.150334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1170/2333] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:32 2022] PUT /identity/v3/projects/3aff04f4481a4b67a8fce26638143e00/users/1aa4e938159d4074a4aa65b7ef2dc76f/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:32.160683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01adc-4329-42ea-bd4f-afdaed33f763 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:32.160974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01adc-4329-42ea-bd4f-afdaed33f763 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:32.161317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01adc-4329-42ea-bd4f-afdaed33f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:32.190323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bda01adc-4329-42ea-bd4f-afdaed33f763 None None] MFA Rules not processed for user `1aa4e938159d4074a4aa65b7ef2dc76f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:32.191561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bda01adc-4329-42ea-bd4f-afdaed33f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:32.264446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1164/2334] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:32.275635 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d03a5e-aee9-447f-8d54-f630cb7a9f78 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:32.277451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-67d03a5e-aee9-447f-8d54-f630cb7a9f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:32.337143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d03a5e-aee9-447f-8d54-f630cb7a9f78 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:32.340745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abeb48-00c2-42ee-9655-b0ed8a57c2cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:32.341347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abeb48-00c2-42ee-9655-b0ed8a57c2cb service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:32.341622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abeb48-00c2-42ee-9655-b0ed8a57c2cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:32.341893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abeb48-00c2-42ee-9655-b0ed8a57c2cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:32.351907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abeb48-00c2-42ee-9655-b0ed8a57c2cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:32.353420 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abeb48-00c2-42ee-9655-b0ed8a57c2cb service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:32.363642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1171/2335] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:32.493950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01adc-4329-42ea-bd4f-afdaed33f763 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:32.495473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bda01adc-4329-42ea-bd4f-afdaed33f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:32.508609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01adc-4329-42ea-bd4f-afdaed33f763 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:32.512293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f1527-751e-48ac-9d63-a1c981285fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:32.513120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f1527-751e-48ac-9d63-a1c981285fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:32.513386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f1527-751e-48ac-9d63-a1c981285fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:32.513663 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f1527-751e-48ac-9d63-a1c981285fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:32.557265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:32.572517 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d9f3-122d-469d-8cb5-17424180727d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:32.572803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d9f3-122d-469d-8cb5-17424180727d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:32.573119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d9f3-122d-469d-8cb5-17424180727d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:32.574265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f1527-751e-48ac-9d63-a1c981285fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:32.574865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1172/2336] 10.222.0.18 () {54 vars in 921 bytes} [Thu Sep 1 12:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 12:26:32.575823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f1527-751e-48ac-9d63-a1c981285fc0 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:32.585728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1165/2337] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:32.603719 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fdce9-bf33-4748-902e-f65b110a82fd None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:32.604098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fdce9-bf33-4748-902e-f65b110a82fd None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:32.604646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fdce9-bf33-4748-902e-f65b110a82fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:32.629166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3e5fdce9-bf33-4748-902e-f65b110a82fd None None] MFA Rules not processed for user `81919eaf832b4025a2118feb4e7fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:32.630984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3e5fdce9-bf33-4748-902e-f65b110a82fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:32.704012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f1527-751e-48ac-9d63-a1c981285fc0 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:32.705668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4d1f1527-751e-48ac-9d63-a1c981285fc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:32.731907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1173/2338] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Sep 1 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:32.747010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fdce9-bf33-4748-902e-f65b110a82fd None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:32.751333 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3e5fdce9-bf33-4748-902e-f65b110a82fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:32.767629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fdce9-bf33-4748-902e-f65b110a82fd None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:32.773122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be5928-4e0b-40b6-acef-021e0797f056 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:32.773816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5928-4e0b-40b6-acef-021e0797f056 service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:32.779306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5928-4e0b-40b6-acef-021e0797f056 service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:32.779306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5928-4e0b-40b6-acef-021e0797f056 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:32.781422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:32.785350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be5928-4e0b-40b6-acef-021e0797f056 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:32.786936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be5928-4e0b-40b6-acef-021e0797f056 service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:32.792241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f1527-751e-48ac-9d63-a1c981285fc0 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:32.799196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:32.799782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1174/2339] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:32.799950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:32.800365 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:32.800713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] PATH_INFO: `/v3/users/26877baf29c74d2d93a30313ea94c775` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:32.802192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26877baf29c74d2d93a30313ea94c775)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:32.804343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:32.971664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26877baf29c74d2d93a30313ea94c775'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:32.978740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26877baf29c74d2d93a30313ea94c775'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:33.048418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26877baf29c74d2d93a30313ea94c775'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:33.049062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26877baf29c74d2d93a30313ea94c775'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:33.049681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26877baf29c74d2d93a30313ea94c775'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:33.068556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1166/2340] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:26:32 2022] DELETE /identity/v3/users/26877baf29c74d2d93a30313ea94c775 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:26:33.325036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be5928-4e0b-40b6-acef-021e0797f056 service placement] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:33.337688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be5928-4e0b-40b6-acef-021e0797f056 service placement] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:33.397089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:33.397718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:33.398028 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:33.398306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] PATH_INFO: `/v3/projects/8be25246a1064b2b939770efb0cd5b26` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:33.399445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be25246a1064b2b939770efb0cd5b26)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:33.401439 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:33.506846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be25246a1064b2b939770efb0cd5b26', 'request_id': 'req-9d95cac3-6364-4fda-a777-587c1f307135'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:33.513806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be25246a1064b2b939770efb0cd5b26', 'request_id': 'req-9d95cac3-6364-4fda-a777-587c1f307135'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:33.557159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be25246a1064b2b939770efb0cd5b26', 'request_id': 'req-9d95cac3-6364-4fda-a777-587c1f307135'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:33.568375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] The token cache is being invalidate because project 8be25246a1064b2b939770efb0cd5b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:26:33.568667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:33.569298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9d95cac3-6364-4fda-a777-587c1f307135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:33.570795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1175/2341] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:26:33 2022] DELETE /identity/v3/projects/8be25246a1064b2b939770efb0cd5b26 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:37.469828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:37.471699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:37.484957 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150e1c0-11dc-4ee5-8d17-4f6550e7dc97 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:37.543203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:37.543831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:37.544107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:37.544407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] PATH_INFO: `/v3/users/def6051f2b1e404b85bd78d41aee41bc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:37.545504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=def6051f2b1e404b85bd78d41aee41bc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:37.547428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:37.548941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:37.770644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def6051f2b1e404b85bd78d41aee41bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:37.777484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def6051f2b1e404b85bd78d41aee41bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:38.025302 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def6051f2b1e404b85bd78d41aee41bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:38.025926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def6051f2b1e404b85bd78d41aee41bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:38.026536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def6051f2b1e404b85bd78d41aee41bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:38.045638 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1167/2342] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:26:37 2022] DELETE /identity/v3/users/def6051f2b1e404b85bd78d41aee41bc => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:38.050267 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326999-cc3d-49fd-b753-a9c319185026 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:38.050755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326999-cc3d-49fd-b753-a9c319185026 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:38.050860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326999-cc3d-49fd-b753-a9c319185026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:38.069464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-12326999-cc3d-49fd-b753-a9c319185026 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:38.071501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-12326999-cc3d-49fd-b753-a9c319185026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:38.128473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1176/2343] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:38.139149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:38.141156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:38.199442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816b1ce-7add-49cb-bf01-b8fdd8b235ed admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:38.203321 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7bb7-8115-48d3-8cd0-5e3b36a513f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:38.203928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7bb7-8115-48d3-8cd0-5e3b36a513f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:38.204225 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7bb7-8115-48d3-8cd0-5e3b36a513f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:38.204515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7bb7-8115-48d3-8cd0-5e3b36a513f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:38.213482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b7bb7-8115-48d3-8cd0-5e3b36a513f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:38.215855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b7bb7-8115-48d3-8cd0-5e3b36a513f0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:38.225111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1168/2344] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:38.707995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12326999-cc3d-49fd-b753-a9c319185026 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:38.709579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-12326999-cc3d-49fd-b753-a9c319185026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:38.725874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12326999-cc3d-49fd-b753-a9c319185026 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:38.730938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:38.739181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:38.739181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:38.739181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] PATH_INFO: `/v3/projects/0226420014e946b5844f90d80848075a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:38.739181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0226420014e946b5844f90d80848075a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:38.739181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:38.757017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:38.837909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0226420014e946b5844f90d80848075a', 'request_id': 'req-f09475de-78cb-474e-82aa-8208f4b3c987'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:38.843998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0226420014e946b5844f90d80848075a', 'request_id': 'req-f09475de-78cb-474e-82aa-8208f4b3c987'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:38.905725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0226420014e946b5844f90d80848075a', 'request_id': 'req-f09475de-78cb-474e-82aa-8208f4b3c987'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:38.916134 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] The token cache is being invalidate because project 0226420014e946b5844f90d80848075a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:26:38.916452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:38.917089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:38.918575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1177/2345] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:26:38 2022] DELETE /identity/v3/projects/0226420014e946b5844f90d80848075a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:38.922494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7bb7-8115-48d3-8cd0-5e3b36a513f0 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:38.931900 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7bb7-8115-48d3-8cd0-5e3b36a513f0 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:38.986899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:38.987520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:38.987800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:38.988076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] PATH_INFO: `/v3/users/1aa4e938159d4074a4aa65b7ef2dc76f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:38.989243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa4e938159d4074a4aa65b7ef2dc76f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:38.991161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:39.014944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:39.205580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa4e938159d4074a4aa65b7ef2dc76f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:39.212381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa4e938159d4074a4aa65b7ef2dc76f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:39.293393 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa4e938159d4074a4aa65b7ef2dc76f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:39.294004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa4e938159d4074a4aa65b7ef2dc76f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:39.294611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-abdca373-14ef-4788-881b-5a88649b3f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa4e938159d4074a4aa65b7ef2dc76f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:39.312698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1169/2346] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:26:38 2022] DELETE /identity/v3/users/1aa4e938159d4074a4aa65b7ef2dc76f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:39.701859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:39.703354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:39.718969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09475de-78cb-474e-82aa-8208f4b3c987 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:39.775235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:39.775865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:39.776148 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:39.776463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] PATH_INFO: `/v3/projects/3aff04f4481a4b67a8fce26638143e00` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:39.778049 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aff04f4481a4b67a8fce26638143e00)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:39.779941 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:39.889798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aff04f4481a4b67a8fce26638143e00', 'request_id': 'req-574c00a0-25aa-42e6-8b27-536bb963d44d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:39.896051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aff04f4481a4b67a8fce26638143e00', 'request_id': 'req-574c00a0-25aa-42e6-8b27-536bb963d44d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:39.968406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aff04f4481a4b67a8fce26638143e00', 'request_id': 'req-574c00a0-25aa-42e6-8b27-536bb963d44d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:39.979025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] The token cache is being invalidate because project 3aff04f4481a4b67a8fce26638143e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:26:39.979318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:39.979947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-574c00a0-25aa-42e6-8b27-536bb963d44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:39.981515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1178/2347] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:26:39 2022] DELETE /identity/v3/projects/3aff04f4481a4b67a8fce26638143e00 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:39.986644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cafa9-9ea8-454c-8b73-1d1a6418d9ab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:39.991833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cafa9-9ea8-454c-8b73-1d1a6418d9ab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:39.991833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cafa9-9ea8-454c-8b73-1d1a6418d9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.007103 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d36cafa9-9ea8-454c-8b73-1d1a6418d9ab None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:40.008391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d36cafa9-9ea8-454c-8b73-1d1a6418d9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:40.067021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1170/2348] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:40.076544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd03bf9-78b7-4bcf-99ca-225bf73d621e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:40.076857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd03bf9-78b7-4bcf-99ca-225bf73d621e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:40.077129 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd03bf9-78b7-4bcf-99ca-225bf73d621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.097291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6fd03bf9-78b7-4bcf-99ca-225bf73d621e None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:40.098522 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6fd03bf9-78b7-4bcf-99ca-225bf73d621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:40.106348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1179/2349] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:40.110511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cafa9-9ea8-454c-8b73-1d1a6418d9ab None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:40.120027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cafa9-9ea8-454c-8b73-1d1a6418d9ab None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:40.124768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653ba67-14aa-4d83-9ac5-d7df943c4962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:40.125351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653ba67-14aa-4d83-9ac5-d7df943c4962 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:40.125631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653ba67-14aa-4d83-9ac5-d7df943c4962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:40.125901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653ba67-14aa-4d83-9ac5-d7df943c4962 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.126565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653ba67-14aa-4d83-9ac5-d7df943c4962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:26:40.126865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653ba67-14aa-4d83-9ac5-d7df943c4962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:40.128480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653ba67-14aa-4d83-9ac5-d7df943c4962 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:40.140405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1171/2350] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:26:40.146615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd03bf9-78b7-4bcf-99ca-225bf73d621e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:40.154350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd03bf9-78b7-4bcf-99ca-225bf73d621e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:40.159082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267289cc-06bc-4ede-89c6-b9775d7139bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:40.159677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267289cc-06bc-4ede-89c6-b9775d7139bf admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:40.159959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267289cc-06bc-4ede-89c6-b9775d7139bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:40.160265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267289cc-06bc-4ede-89c6-b9775d7139bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.160895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267289cc-06bc-4ede-89c6-b9775d7139bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:40.162789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267289cc-06bc-4ede-89c6-b9775d7139bf admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:40.261519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1180/2351] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:26:40 2022] POST /identity/v3/projects => generated 409 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:40.266017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653ba67-14aa-4d83-9ac5-d7df943c4962 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:40.275771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653ba67-14aa-4d83-9ac5-d7df943c4962 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:40.330804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b181a8-e34b-4897-b845-7341ae27cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:40.331398 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b181a8-e34b-4897-b845-7341ae27cadd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:40.331674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b181a8-e34b-4897-b845-7341ae27cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:40.331945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b181a8-e34b-4897-b845-7341ae27cadd admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.332601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b181a8-e34b-4897-b845-7341ae27cadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:40.334493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b181a8-e34b-4897-b845-7341ae27cadd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:40.419438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1172/2352] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:26:40 2022] POST /identity/v3/users => generated 305 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:40.423603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267289cc-06bc-4ede-89c6-b9775d7139bf admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:40.434902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267289cc-06bc-4ede-89c6-b9775d7139bf admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:40.439554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b612ddc-de41-454c-b70e-34661e1ad63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:40.440161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b612ddc-de41-454c-b70e-34661e1ad63b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:40.440475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b612ddc-de41-454c-b70e-34661e1ad63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:40.440828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b612ddc-de41-454c-b70e-34661e1ad63b admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.441482 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b612ddc-de41-454c-b70e-34661e1ad63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:40.443063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b612ddc-de41-454c-b70e-34661e1ad63b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:40.445084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:40.454123 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1181/2353] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:40.459502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b181a8-e34b-4897-b845-7341ae27cadd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:40.469251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b181a8-e34b-4897-b845-7341ae27cadd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:40.474055 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94b772-4caa-49ec-a68b-c1b83a9e2474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:40.474652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94b772-4caa-49ec-a68b-c1b83a9e2474 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:40.474935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94b772-4caa-49ec-a68b-c1b83a9e2474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:40.475209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94b772-4caa-49ec-a68b-c1b83a9e2474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.475886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94b772-4caa-49ec-a68b-c1b83a9e2474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:40.477528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94b772-4caa-49ec-a68b-c1b83a9e2474 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:40.488107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1173/2354] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:40.492145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b612ddc-de41-454c-b70e-34661e1ad63b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:40.503186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b612ddc-de41-454c-b70e-34661e1ad63b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:40.507721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ac5ed-771f-4c0c-b390-0b16eb97b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:40.508663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ac5ed-771f-4c0c-b390-0b16eb97b410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:40.508891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ac5ed-771f-4c0c-b390-0b16eb97b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:40.509002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ac5ed-771f-4c0c-b390-0b16eb97b410 admin admin] PATH_INFO: `/v3/projects/7bc0e1ca4d29448b8ed2252dbefced1c/users/27cea0545e464ecd810390ce2c3a90f3/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.523842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ac5ed-771f-4c0c-b390-0b16eb97b410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc0e1ca4d29448b8ed2252dbefced1c, user_id=27cea0545e464ecd810390ce2c3a90f3, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:40.526421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ac5ed-771f-4c0c-b390-0b16eb97b410 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:40.596167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1182/2355] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:40 2022] PUT /identity/v3/projects/7bc0e1ca4d29448b8ed2252dbefced1c/users/27cea0545e464ecd810390ce2c3a90f3/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:26:40.606834 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ded7d-967f-4513-b5ed-69dc25253c0a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:40.607161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ded7d-967f-4513-b5ed-69dc25253c0a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:40.607445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ded7d-967f-4513-b5ed-69dc25253c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.620840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:40.635586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-702ded7d-967f-4513-b5ed-69dc25253c0a None None] MFA Rules not processed for user `27cea0545e464ecd810390ce2c3a90f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:40.636819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-702ded7d-967f-4513-b5ed-69dc25253c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:40.701927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1174/2356] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:40.706739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ac5ed-771f-4c0c-b390-0b16eb97b410 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:40.768044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ac5ed-771f-4c0c-b390-0b16eb97b410 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:40.772863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c7855-c135-440a-b063-4e885cca2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:40.773461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c7855-c135-440a-b063-4e885cca2e1a admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:40.773736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c7855-c135-440a-b063-4e885cca2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:40.774060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c7855-c135-440a-b063-4e885cca2e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.774640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c7855-c135-440a-b063-4e885cca2e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:40.776577 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c7855-c135-440a-b063-4e885cca2e1a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:40.861698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1183/2357] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:26:40 2022] POST /identity/v3/projects => generated 409 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:40.865958 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ded7d-967f-4513-b5ed-69dc25253c0a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:40.877472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ded7d-967f-4513-b5ed-69dc25253c0a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:40.932571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329c597-2551-442e-afbe-628be36e75fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:40.933226 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329c597-2551-442e-afbe-628be36e75fc admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:40.934108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329c597-2551-442e-afbe-628be36e75fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:40.934411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329c597-2551-442e-afbe-628be36e75fc admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:40.935050 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329c597-2551-442e-afbe-628be36e75fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:40.936990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329c597-2551-442e-afbe-628be36e75fc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:41.031718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1175/2358] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:26:40 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:41.035797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c7855-c135-440a-b063-4e885cca2e1a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:41.046619 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c7855-c135-440a-b063-4e885cca2e1a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:41.051319 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df73b6-b08e-4082-a72a-c93849b3bfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:41.051917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df73b6-b08e-4082-a72a-c93849b3bfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:41.052201 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df73b6-b08e-4082-a72a-c93849b3bfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:41.052508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df73b6-b08e-4082-a72a-c93849b3bfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:41.053153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df73b6-b08e-4082-a72a-c93849b3bfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:41.054803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df73b6-b08e-4082-a72a-c93849b3bfa1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:41.065376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1184/2359] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:41.069332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329c597-2551-442e-afbe-628be36e75fc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:41.079010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329c597-2551-442e-afbe-628be36e75fc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:41.083639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2cea-1d86-4ad3-bb15-c5624625ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:41.084307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2cea-1d86-4ad3-bb15-c5624625ad7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:41.084608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2cea-1d86-4ad3-bb15-c5624625ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:41.084872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2cea-1d86-4ad3-bb15-c5624625ad7d admin admin] PATH_INFO: `/v3/projects/b977f445ac2a4e668143017b52905ffe/users/33284d8c74a44171b741bd7c21d93e43/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:41.099955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2cea-1d86-4ad3-bb15-c5624625ad7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b977f445ac2a4e668143017b52905ffe, user_id=33284d8c74a44171b741bd7c21d93e43, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:41.102687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2cea-1d86-4ad3-bb15-c5624625ad7d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:41.186142 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1176/2360] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:41 2022] PUT /identity/v3/projects/b977f445ac2a4e668143017b52905ffe/users/33284d8c74a44171b741bd7c21d93e43/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:41.190271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df73b6-b08e-4082-a72a-c93849b3bfa1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:41.200104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df73b6-b08e-4082-a72a-c93849b3bfa1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:41.256433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8a51-082a-4ef1-8e25-b44c1a98295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:41.257036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8a51-082a-4ef1-8e25-b44c1a98295c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:41.257408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8a51-082a-4ef1-8e25-b44c1a98295c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:41.257688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8a51-082a-4ef1-8e25-b44c1a98295c admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:41.258323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8a51-082a-4ef1-8e25-b44c1a98295c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:41.259901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8a51-082a-4ef1-8e25-b44c1a98295c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:41.269622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1185/2361] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:41.273966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2cea-1d86-4ad3-bb15-c5624625ad7d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:41.285955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2cea-1d86-4ad3-bb15-c5624625ad7d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:41.289724 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6cb1d-a94f-4722-831b-144523d270e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:41.290367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6cb1d-a94f-4722-831b-144523d270e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:41.290649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6cb1d-a94f-4722-831b-144523d270e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:41.290931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6cb1d-a94f-4722-831b-144523d270e5 admin admin] PATH_INFO: `/v3/projects/b977f445ac2a4e668143017b52905ffe/users/33284d8c74a44171b741bd7c21d93e43/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:41.292854 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6cb1d-a94f-4722-831b-144523d270e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b977f445ac2a4e668143017b52905ffe, user_id=33284d8c74a44171b741bd7c21d93e43, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:41.296083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6cb1d-a94f-4722-831b-144523d270e5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:41.306306 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1177/2362] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:41 2022] PUT /identity/v3/projects/b977f445ac2a4e668143017b52905ffe/users/33284d8c74a44171b741bd7c21d93e43/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:41.317314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b57098-9bb5-4652-91dd-df4a30e38c7e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:41.320434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b57098-9bb5-4652-91dd-df4a30e38c7e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:41.320434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b57098-9bb5-4652-91dd-df4a30e38c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:41.346186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-80b57098-9bb5-4652-91dd-df4a30e38c7e None None] MFA Rules not processed for user `33284d8c74a44171b741bd7c21d93e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:41.347372 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-80b57098-9bb5-4652-91dd-df4a30e38c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:41.380339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:41.416400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1186/2363] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:41.427194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6cb1d-a94f-4722-831b-144523d270e5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:41.428959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-68b6cb1d-a94f-4722-831b-144523d270e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:41.482640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:41.486351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6cb1d-a94f-4722-831b-144523d270e5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:41.490249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660ed41-d503-4d26-97fa-e18ef87ccad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:41.490861 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660ed41-d503-4d26-97fa-e18ef87ccad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:41.491145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660ed41-d503-4d26-97fa-e18ef87ccad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:41.492412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660ed41-d503-4d26-97fa-e18ef87ccad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:41.500898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660ed41-d503-4d26-97fa-e18ef87ccad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:41.502317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660ed41-d503-4d26-97fa-e18ef87ccad0 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:41.511681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1178/2364] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:41 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:26:41.893591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b57098-9bb5-4652-91dd-df4a30e38c7e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:41.903302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b57098-9bb5-4652-91dd-df4a30e38c7e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:41.906904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4f44b-e3fa-4ac6-a4de-6acdff27a11a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:41.907525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f44b-e3fa-4ac6-a4de-6acdff27a11a service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:41.907804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f44b-e3fa-4ac6-a4de-6acdff27a11a service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:41.908305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f44b-e3fa-4ac6-a4de-6acdff27a11a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:41.964297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4f44b-e3fa-4ac6-a4de-6acdff27a11a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:41.965724 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4f44b-e3fa-4ac6-a4de-6acdff27a11a service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:41.974524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1187/2365] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:41 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:48.927112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660ed41-d503-4d26-97fa-e18ef87ccad0 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:48.987649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660ed41-d503-4d26-97fa-e18ef87ccad0 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:48.992077 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:48.992726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:48.993009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:48.993286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] PATH_INFO: `/v3/users/27cea0545e464ecd810390ce2c3a90f3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:48.994399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cea0545e464ecd810390ce2c3a90f3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:48.996654 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:49.130357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cea0545e464ecd810390ce2c3a90f3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:49.137122 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cea0545e464ecd810390ce2c3a90f3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:49.191438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cea0545e464ecd810390ce2c3a90f3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:49.192126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cea0545e464ecd810390ce2c3a90f3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:49.192783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cea0545e464ecd810390ce2c3a90f3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:49.210513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1179/2366] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:26:48 2022] DELETE /identity/v3/users/27cea0545e464ecd810390ce2c3a90f3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:49.215339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a03919-aa71-42e8-93db-5cec07c1e9ac None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:49.215837 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a03919-aa71-42e8-93db-5cec07c1e9ac None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:49.215965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a03919-aa71-42e8-93db-5cec07c1e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:49.235607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-00a03919-aa71-42e8-93db-5cec07c1e9ac None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:49.236839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-00a03919-aa71-42e8-93db-5cec07c1e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:49.295191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1188/2367] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:26:49.304817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:49.306255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:49.363078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8bec-4d5a-49c7-b5e5-2fc4920f2427 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:49.366713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7dc6a-ad42-4120-b4f1-e98bcfbf5b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:49.367309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7dc6a-ad42-4120-b4f1-e98bcfbf5b0d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:49.367589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7dc6a-ad42-4120-b4f1-e98bcfbf5b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:49.367863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7dc6a-ad42-4120-b4f1-e98bcfbf5b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:49.376997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7dc6a-ad42-4120-b4f1-e98bcfbf5b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:49.378411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7dc6a-ad42-4120-b4f1-e98bcfbf5b0d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:49.387659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1180/2368] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:49.776139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a03919-aa71-42e8-93db-5cec07c1e9ac None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:49.777736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-00a03919-aa71-42e8-93db-5cec07c1e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:49.791466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a03919-aa71-42e8-93db-5cec07c1e9ac None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:49.796129 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:49.796791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:49.797066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:49.797337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] PATH_INFO: `/v3/projects/7bc0e1ca4d29448b8ed2252dbefced1c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:49.798598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc0e1ca4d29448b8ed2252dbefced1c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:49.800510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:49.895581 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc0e1ca4d29448b8ed2252dbefced1c', 'request_id': 'req-a7d8ec56-66ed-4443-a997-835991ca31d3'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:49.902010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc0e1ca4d29448b8ed2252dbefced1c', 'request_id': 'req-a7d8ec56-66ed-4443-a997-835991ca31d3'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:49.974263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc0e1ca4d29448b8ed2252dbefced1c', 'request_id': 'req-a7d8ec56-66ed-4443-a997-835991ca31d3'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:49.976314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:49.985271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] The token cache is being invalidate because project 7bc0e1ca4d29448b8ed2252dbefced1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:26:49.985557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:49.986169 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:49.987745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1189/2369] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:26:49 2022] DELETE /identity/v3/projects/7bc0e1ca4d29448b8ed2252dbefced1c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:26:49.991890 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7dc6a-ad42-4120-b4f1-e98bcfbf5b0d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:50.002394 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7dc6a-ad42-4120-b4f1-e98bcfbf5b0d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:50.011249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:50.058716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:50.059338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:50.059678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:50.059955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] PATH_INFO: `/v3/users/33284d8c74a44171b741bd7c21d93e43` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:50.061642 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33284d8c74a44171b741bd7c21d93e43)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:50.063583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:50.325779 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33284d8c74a44171b741bd7c21d93e43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:50.332653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33284d8c74a44171b741bd7c21d93e43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:50.408346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33284d8c74a44171b741bd7c21d93e43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:50.409000 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33284d8c74a44171b741bd7c21d93e43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:50.409652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1a17d750-ab80-43b0-bfd4-fd56565c1337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33284d8c74a44171b741bd7c21d93e43'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:50.427633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1181/2370] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:26:49 2022] DELETE /identity/v3/users/33284d8c74a44171b741bd7c21d93e43 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:50.833257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:50.834751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:50.850285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8ec56-66ed-4443-a997-835991ca31d3 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:50.907900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:50.908557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:50.908836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:50.909110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] PATH_INFO: `/v3/projects/b977f445ac2a4e668143017b52905ffe` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:50.910256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b977f445ac2a4e668143017b52905ffe)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:50.912154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:51.001982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b977f445ac2a4e668143017b52905ffe', 'request_id': 'req-e107949c-8964-44a0-a622-33ad9c0ef05a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:51.007959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b977f445ac2a4e668143017b52905ffe', 'request_id': 'req-e107949c-8964-44a0-a622-33ad9c0ef05a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:51.048188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b977f445ac2a4e668143017b52905ffe', 'request_id': 'req-e107949c-8964-44a0-a622-33ad9c0ef05a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:51.058716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] The token cache is being invalidate because project b977f445ac2a4e668143017b52905ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:26:51.058998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:51.059614 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e107949c-8964-44a0-a622-33ad9c0ef05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:26:51.061185 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1190/2371] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:26:50 2022] DELETE /identity/v3/projects/b977f445ac2a4e668143017b52905ffe => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:51.066038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019d82-645c-4afe-a9a5-92edd60f7858 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:51.066527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019d82-645c-4afe-a9a5-92edd60f7858 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:51.066665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019d82-645c-4afe-a9a5-92edd60f7858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:51.086527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-61019d82-645c-4afe-a9a5-92edd60f7858 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:51.087773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-61019d82-645c-4afe-a9a5-92edd60f7858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:51.147104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1182/2372] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:51.291519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3b9c2-f04c-48c6-a6ad-e5a83a08b72d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:51.291519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3b9c2-f04c-48c6-a6ad-e5a83a08b72d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:51.291519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3b9c2-f04c-48c6-a6ad-e5a83a08b72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:51.291519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1ad3b9c2-f04c-48c6-a6ad-e5a83a08b72d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:51.291519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1ad3b9c2-f04c-48c6-a6ad-e5a83a08b72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:51.291519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1191/2373] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:51.292152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61019d82-645c-4afe-a9a5-92edd60f7858 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:51.292152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61019d82-645c-4afe-a9a5-92edd60f7858 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:51.292152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c651787-bfe3-4b02-9201-85590c34da44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:51.292152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c651787-bfe3-4b02-9201-85590c34da44 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:51.292551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c651787-bfe3-4b02-9201-85590c34da44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:51.292551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c651787-bfe3-4b02-9201-85590c34da44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:51.292551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c651787-bfe3-4b02-9201-85590c34da44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:26:51.292551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c651787-bfe3-4b02-9201-85590c34da44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:51.292551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c651787-bfe3-4b02-9201-85590c34da44 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:51.292551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1183/2374] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:26:51.293069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3b9c2-f04c-48c6-a6ad-e5a83a08b72d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:51.293069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3b9c2-f04c-48c6-a6ad-e5a83a08b72d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:51.293069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d003c5c-e46e-4fab-93c8-34fa0dc3e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:51.293069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d003c5c-e46e-4fab-93c8-34fa0dc3e84a admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:51.293424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d003c5c-e46e-4fab-93c8-34fa0dc3e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:51.293424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d003c5c-e46e-4fab-93c8-34fa0dc3e84a admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:51.293424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d003c5c-e46e-4fab-93c8-34fa0dc3e84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:51.293424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d003c5c-e46e-4fab-93c8-34fa0dc3e84a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:51.346235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1192/2375] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:26:51 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:26:51.350418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c651787-bfe3-4b02-9201-85590c34da44 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:51.360403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c651787-bfe3-4b02-9201-85590c34da44 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:51.380996 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:51.419529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182d5b1-2557-4ff4-b15f-ffb6257f3371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:51.420100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182d5b1-2557-4ff4-b15f-ffb6257f3371 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:51.420409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182d5b1-2557-4ff4-b15f-ffb6257f3371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:51.420712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182d5b1-2557-4ff4-b15f-ffb6257f3371 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:51.421409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182d5b1-2557-4ff4-b15f-ffb6257f3371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:51.423353 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182d5b1-2557-4ff4-b15f-ffb6257f3371 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:51.501387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1184/2376] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:26:51 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:51.505379 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d003c5c-e46e-4fab-93c8-34fa0dc3e84a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:51.515722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d003c5c-e46e-4fab-93c8-34fa0dc3e84a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:51.520538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92c19a-80fc-4d48-b921-a973e168cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:51.521108 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92c19a-80fc-4d48-b921-a973e168cd10 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:51.521386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92c19a-80fc-4d48-b921-a973e168cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:51.521657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92c19a-80fc-4d48-b921-a973e168cd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:51.522299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92c19a-80fc-4d48-b921-a973e168cd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:51.523862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92c19a-80fc-4d48-b921-a973e168cd10 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:51.534008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1193/2377] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:51.537961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182d5b1-2557-4ff4-b15f-ffb6257f3371 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:51.548543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182d5b1-2557-4ff4-b15f-ffb6257f3371 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:51.553156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d22b46-590d-413e-a8cd-58af76dc1738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:51.553745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d22b46-590d-413e-a8cd-58af76dc1738 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:51.554031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d22b46-590d-413e-a8cd-58af76dc1738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:51.554307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d22b46-590d-413e-a8cd-58af76dc1738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:51.554952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d22b46-590d-413e-a8cd-58af76dc1738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:51.556568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d22b46-590d-413e-a8cd-58af76dc1738 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:51.567739 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1185/2378] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:51.571868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92c19a-80fc-4d48-b921-a973e168cd10 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:51.581771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92c19a-80fc-4d48-b921-a973e168cd10 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:51.586365 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4071501-706d-463c-b202-6a47a765f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:51.587003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4071501-706d-463c-b202-6a47a765f514 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:51.587278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4071501-706d-463c-b202-6a47a765f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:51.587547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4071501-706d-463c-b202-6a47a765f514 admin admin] PATH_INFO: `/v3/projects/c12b2c9be0dd46fd999f9aea5d0aae4b/users/04399cf507e24477836855f4fa711c1e/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:51.602115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4071501-706d-463c-b202-6a47a765f514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12b2c9be0dd46fd999f9aea5d0aae4b, user_id=04399cf507e24477836855f4fa711c1e, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:51.605002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4071501-706d-463c-b202-6a47a765f514 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:51.654089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1194/2379] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:51 2022] PUT /identity/v3/projects/c12b2c9be0dd46fd999f9aea5d0aae4b/users/04399cf507e24477836855f4fa711c1e/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:51.659157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22a3c-7ad7-487c-949b-370c6f4f8a79 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:51.660974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22a3c-7ad7-487c-949b-370c6f4f8a79 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:51.660974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b22a3c-7ad7-487c-949b-370c6f4f8a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:51.679088 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-83b22a3c-7ad7-487c-949b-370c6f4f8a79 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:51.680249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-83b22a3c-7ad7-487c-949b-370c6f4f8a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:51.738348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1186/2380] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:51.749141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4071501-706d-463c-b202-6a47a765f514 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:51.750902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f4071501-706d-463c-b202-6a47a765f514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:51.771462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:51.807263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4071501-706d-463c-b202-6a47a765f514 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:51.813393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf8ba-4917-4a59-8b95-8700065ec97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:51.817887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf8ba-4917-4a59-8b95-8700065ec97a service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:51.817887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf8ba-4917-4a59-8b95-8700065ec97a service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:51.817887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf8ba-4917-4a59-8b95-8700065ec97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:51.825011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bf8ba-4917-4a59-8b95-8700065ec97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:51.826489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bf8ba-4917-4a59-8b95-8700065ec97a service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:51.835802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1195/2381] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:26:53.026599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dd664-9327-4bf9-bc6f-e37eecc29f9d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:53.027139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dd664-9327-4bf9-bc6f-e37eecc29f9d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:53.027139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dd664-9327-4bf9-bc6f-e37eecc29f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:53.055380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-772dd664-9327-4bf9-bc6f-e37eecc29f9d None None] MFA Rules not processed for user `04399cf507e24477836855f4fa711c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:53.056746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-772dd664-9327-4bf9-bc6f-e37eecc29f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:53.131241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1187/2382] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:53.135878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf8ba-4917-4a59-8b95-8700065ec97a service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:53.146233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf8ba-4917-4a59-8b95-8700065ec97a service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:53.150982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe724-b8d1-4ae3-b4a4-ef251db1fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:53.151599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe724-b8d1-4ae3-b4a4-ef251db1fc46 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:53.151881 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe724-b8d1-4ae3-b4a4-ef251db1fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:53.152153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe724-b8d1-4ae3-b4a4-ef251db1fc46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:53.152846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fe724-b8d1-4ae3-b4a4-ef251db1fc46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:53.154832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fe724-b8d1-4ae3-b4a4-ef251db1fc46 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:53.236935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1196/2383] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:26:53 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:53.238243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dd664-9327-4bf9-bc6f-e37eecc29f9d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:53.249952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dd664-9327-4bf9-bc6f-e37eecc29f9d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:53.275688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:53.305721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcc18a-21fc-4474-beb8-dec092256e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:53.306653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcc18a-21fc-4474-beb8-dec092256e94 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:53.306982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcc18a-21fc-4474-beb8-dec092256e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:53.307251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcc18a-21fc-4474-beb8-dec092256e94 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:53.307872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcc18a-21fc-4474-beb8-dec092256e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:53.309828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcc18a-21fc-4474-beb8-dec092256e94 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:53.414383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1188/2384] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:26:53 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:26:53.418450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe724-b8d1-4ae3-b4a4-ef251db1fc46 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:53.429118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe724-b8d1-4ae3-b4a4-ef251db1fc46 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:53.433688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df2848-4e8e-4c51-96dd-0824a04bc851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:53.434272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df2848-4e8e-4c51-96dd-0824a04bc851 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:53.434549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df2848-4e8e-4c51-96dd-0824a04bc851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:53.434820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df2848-4e8e-4c51-96dd-0824a04bc851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:53.435456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df2848-4e8e-4c51-96dd-0824a04bc851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:53.437132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df2848-4e8e-4c51-96dd-0824a04bc851 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:53.448472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1197/2385] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:53.452562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcc18a-21fc-4474-beb8-dec092256e94 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:53.462441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcc18a-21fc-4474-beb8-dec092256e94 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:53.467698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4d465-ebb2-4d7d-bf11-53ba06d40b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:53.468374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4d465-ebb2-4d7d-bf11-53ba06d40b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:53.468654 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4d465-ebb2-4d7d-bf11-53ba06d40b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:53.468929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4d465-ebb2-4d7d-bf11-53ba06d40b33 admin admin] PATH_INFO: `/v3/projects/0f0b2399540e48759efa2ce8946af39c/users/e2490aad78f94a5eb6e4bea60f8b3e83/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:53.484028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4d465-ebb2-4d7d-bf11-53ba06d40b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0b2399540e48759efa2ce8946af39c, user_id=e2490aad78f94a5eb6e4bea60f8b3e83, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:53.486747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4d465-ebb2-4d7d-bf11-53ba06d40b33 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:53.547335 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1189/2386] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:53 2022] PUT /identity/v3/projects/0f0b2399540e48759efa2ce8946af39c/users/e2490aad78f94a5eb6e4bea60f8b3e83/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:53.551220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df2848-4e8e-4c51-96dd-0824a04bc851 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:53.561100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df2848-4e8e-4c51-96dd-0824a04bc851 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:53.615741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ef765-47aa-4f71-bae2-685773b16c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:53.616373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ef765-47aa-4f71-bae2-685773b16c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:53.616650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ef765-47aa-4f71-bae2-685773b16c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:53.616920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ef765-47aa-4f71-bae2-685773b16c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:53.617559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ef765-47aa-4f71-bae2-685773b16c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:53.619124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ef765-47aa-4f71-bae2-685773b16c71 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:53.629013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1198/2387] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:26:53.633257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4d465-ebb2-4d7d-bf11-53ba06d40b33 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:53.643658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4d465-ebb2-4d7d-bf11-53ba06d40b33 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:53.648394 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9012345-d997-49c5-aa5d-00d6432c75f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:53.649041 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9012345-d997-49c5-aa5d-00d6432c75f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:53.649320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9012345-d997-49c5-aa5d-00d6432c75f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:53.649597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9012345-d997-49c5-aa5d-00d6432c75f4 admin admin] PATH_INFO: `/v3/projects/0f0b2399540e48759efa2ce8946af39c/users/e2490aad78f94a5eb6e4bea60f8b3e83/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:53.651518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9012345-d997-49c5-aa5d-00d6432c75f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0b2399540e48759efa2ce8946af39c, user_id=e2490aad78f94a5eb6e4bea60f8b3e83, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:53.654666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9012345-d997-49c5-aa5d-00d6432c75f4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:53.664882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1190/2388] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:26:53 2022] PUT /identity/v3/projects/0f0b2399540e48759efa2ce8946af39c/users/e2490aad78f94a5eb6e4bea60f8b3e83/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:26:54.703882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a3dae-793b-4fba-ba02-b16314778fa0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:54.704504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a3dae-793b-4fba-ba02-b16314778fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:54.704504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a3dae-793b-4fba-ba02-b16314778fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:54.733520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3c2a3dae-793b-4fba-ba02-b16314778fa0 None None] MFA Rules not processed for user `e2490aad78f94a5eb6e4bea60f8b3e83`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:54.734748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3c2a3dae-793b-4fba-ba02-b16314778fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:54.806962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1199/2389] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:54.817735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856423b-8a02-4dfe-acf5-c6f17f4737dd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:54.818412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856423b-8a02-4dfe-acf5-c6f17f4737dd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:54.818412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856423b-8a02-4dfe-acf5-c6f17f4737dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:54.839333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c856423b-8a02-4dfe-acf5-c6f17f4737dd None None] MFA Rules not processed for user `04399cf507e24477836855f4fa711c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:26:54.840598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c856423b-8a02-4dfe-acf5-c6f17f4737dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:54.895628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1191/2390] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:26:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:26:54.908980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a3dae-793b-4fba-ba02-b16314778fa0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:26:54.910359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3c2a3dae-793b-4fba-ba02-b16314778fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:26:54.921930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:26:54.981232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a3dae-793b-4fba-ba02-b16314778fa0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:26:54.987351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fb84b-c20e-4df8-b18b-a70dda382a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:26:54.987953 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb84b-c20e-4df8-b18b-a70dda382a15 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:26:54.988257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb84b-c20e-4df8-b18b-a70dda382a15 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:26:54.988536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb84b-c20e-4df8-b18b-a70dda382a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:26:54.996296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fb84b-c20e-4df8-b18b-a70dda382a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:26:54.998373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fb84b-c20e-4df8-b18b-a70dda382a15 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:26:55.007654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1200/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:26:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:27:04.889424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=56,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:05.082939 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=30 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:13.620796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856423b-8a02-4dfe-acf5-c6f17f4737dd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:13.622250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c856423b-8a02-4dfe-acf5-c6f17f4737dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:13.716853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856423b-8a02-4dfe-acf5-c6f17f4737dd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:13.720606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533ba8-2d22-492e-9a6e-af80f5cc1838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:13.721230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533ba8-2d22-492e-9a6e-af80f5cc1838 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:13.721567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533ba8-2d22-492e-9a6e-af80f5cc1838 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:13.721786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533ba8-2d22-492e-9a6e-af80f5cc1838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:13.755507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b533ba8-2d22-492e-9a6e-af80f5cc1838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:13.757034 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b533ba8-2d22-492e-9a6e-af80f5cc1838 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:13.768731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1192/2392] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:27:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:27:14.850490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a8c4b-ea12-40e7-811f-2cab9b23c547 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:14.850938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a8c4b-ea12-40e7-811f-2cab9b23c547 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:14.851097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a8c4b-ea12-40e7-811f-2cab9b23c547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:14.872567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-279a8c4b-ea12-40e7-811f-2cab9b23c547 None None] MFA Rules not processed for user `7699159c5e67464ba6b82ec848c24439`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:14.873780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-279a8c4b-ea12-40e7-811f-2cab9b23c547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:14.930834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1201/2393] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:27:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:19.054439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533ba8-2d22-492e-9a6e-af80f5cc1838 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:19.056014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8b533ba8-2d22-492e-9a6e-af80f5cc1838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:19.180476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533ba8-2d22-492e-9a6e-af80f5cc1838 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:19.185911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d0cbb-08e7-4d10-b52c-2462b5df4afb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:19.186540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d0cbb-08e7-4d10-b52c-2462b5df4afb service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:19.186819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d0cbb-08e7-4d10-b52c-2462b5df4afb service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:19.187087 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d0cbb-08e7-4d10-b52c-2462b5df4afb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:19.189135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-589d0cbb-08e7-4d10-b52c-2462b5df4afb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:19.205529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d0cbb-08e7-4d10-b52c-2462b5df4afb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:19.207279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d0cbb-08e7-4d10-b52c-2462b5df4afb service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:19.218231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1193/2394] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:27:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:27:24.923835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=25 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:29.213607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:31.564084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a6acf-b53e-4e5f-8602-2b29d79cf185 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:31.564609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a6acf-b53e-4e5f-8602-2b29d79cf185 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:31.564794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a6acf-b53e-4e5f-8602-2b29d79cf185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:31.595792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-187a6acf-b53e-4e5f-8602-2b29d79cf185 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:31.597065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-187a6acf-b53e-4e5f-8602-2b29d79cf185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:31.658570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1202/2395] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:27:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:31.835991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d0cbb-08e7-4d10-b52c-2462b5df4afb service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:31.837411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-589d0cbb-08e7-4d10-b52c-2462b5df4afb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:31.906743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d0cbb-08e7-4d10-b52c-2462b5df4afb service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:31.912587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b20d-79c0-46b7-8ea0-04fecd1cc171 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:31.914262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b20d-79c0-46b7-8ea0-04fecd1cc171 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:31.914262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b20d-79c0-46b7-8ea0-04fecd1cc171 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:31.914262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b20d-79c0-46b7-8ea0-04fecd1cc171 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:31.922362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4b20d-79c0-46b7-8ea0-04fecd1cc171 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:31.923937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4b20d-79c0-46b7-8ea0-04fecd1cc171 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:31.931908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1194/2396] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:27:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:27:41.651432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=32 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:41.928783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=32 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:42.665832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a6acf-b53e-4e5f-8602-2b29d79cf185 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:42.757255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a6acf-b53e-4e5f-8602-2b29d79cf185 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:42.761771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:42.762400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:42.762684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:42.762956 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] PATH_INFO: `/v3/users/04399cf507e24477836855f4fa711c1e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:42.764074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04399cf507e24477836855f4fa711c1e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:42.766055 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:42.969316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04399cf507e24477836855f4fa711c1e'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:42.976266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04399cf507e24477836855f4fa711c1e'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:42.976970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04399cf507e24477836855f4fa711c1e'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:43.037270 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04399cf507e24477836855f4fa711c1e'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:43.054084 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04399cf507e24477836855f4fa711c1e'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:43.063682 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1203/2397] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:27:42 2022] DELETE /identity/v3/users/04399cf507e24477836855f4fa711c1e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:27:43.370672 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b20d-79c0-46b7-8ea0-04fecd1cc171 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:43.381220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b20d-79c0-46b7-8ea0-04fecd1cc171 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:43.477881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:43.478760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:43.479156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:43.479527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] PATH_INFO: `/v3/projects/c12b2c9be0dd46fd999f9aea5d0aae4b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:43.480823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12b2c9be0dd46fd999f9aea5d0aae4b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:43.482801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:43.622129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12b2c9be0dd46fd999f9aea5d0aae4b', 'request_id': 'req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:43.629693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12b2c9be0dd46fd999f9aea5d0aae4b', 'request_id': 'req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:43.635449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12b2c9be0dd46fd999f9aea5d0aae4b', 'request_id': 'req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:43.780973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] The token cache is being invalidate because project c12b2c9be0dd46fd999f9aea5d0aae4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:27:43.790120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:43.790120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:43.790120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1195/2398] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:27:43 2022] DELETE /identity/v3/projects/c12b2c9be0dd46fd999f9aea5d0aae4b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:27:43.790447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:43.790447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:43.802251 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2575fb-332d-4736-b876-2ad05365c27d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:43.859334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:43.859992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:43.860307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:43.860589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] PATH_INFO: `/v3/users/e2490aad78f94a5eb6e4bea60f8b3e83` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:43.861716 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2490aad78f94a5eb6e4bea60f8b3e83)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:43.863637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:43.865950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:44.123552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2490aad78f94a5eb6e4bea60f8b3e83'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:44.130921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2490aad78f94a5eb6e4bea60f8b3e83'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:44.131742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2490aad78f94a5eb6e4bea60f8b3e83'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:44.196755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2490aad78f94a5eb6e4bea60f8b3e83'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:44.209859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-cfb10d7b-76eb-4400-9016-fa0e2990ce64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2490aad78f94a5eb6e4bea60f8b3e83'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:44.215813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1204/2399] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:27:43 2022] DELETE /identity/v3/users/e2490aad78f94a5eb6e4bea60f8b3e83 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:27:44.427324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:44.428833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:44.441589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b0c1c-af05-4dca-84eb-2931171fe4e9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:44.498985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:44.499612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:44.500032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:44.500367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] PATH_INFO: `/v3/projects/0f0b2399540e48759efa2ce8946af39c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:44.501489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0b2399540e48759efa2ce8946af39c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:44.503403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:44.525507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:44.602375 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0b2399540e48759efa2ce8946af39c', 'request_id': 'req-c7894c5f-9541-4543-ba4e-2745c7aa97c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:44.609329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0b2399540e48759efa2ce8946af39c', 'request_id': 'req-c7894c5f-9541-4543-ba4e-2745c7aa97c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:44.615528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0b2399540e48759efa2ce8946af39c', 'request_id': 'req-c7894c5f-9541-4543-ba4e-2745c7aa97c5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:44.693945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] The token cache is being invalidate because project 0f0b2399540e48759efa2ce8946af39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:27:44.694268 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:44.695026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c7894c5f-9541-4543-ba4e-2745c7aa97c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:44.696727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1196/2400] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:27:44 2022] DELETE /identity/v3/projects/0f0b2399540e48759efa2ce8946af39c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:27:44.702827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be996e-c40c-41b8-9c8e-60f087061547 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:44.703603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be996e-c40c-41b8-9c8e-60f087061547 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:44.703917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be996e-c40c-41b8-9c8e-60f087061547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:44.771975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-09be996e-c40c-41b8-9c8e-60f087061547 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:44.773251 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-09be996e-c40c-41b8-9c8e-60f087061547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:44.832977 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1205/2401] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:44.900994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459e86-5c10-4623-8e3c-9b0017936b94 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:44.901285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459e86-5c10-4623-8e3c-9b0017936b94 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:44.901564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459e86-5c10-4623-8e3c-9b0017936b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:44.923015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ba459e86-5c10-4623-8e3c-9b0017936b94 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:44.924237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ba459e86-5c10-4623-8e3c-9b0017936b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:44.931994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1197/2402] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:44.936274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be996e-c40c-41b8-9c8e-60f087061547 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:44.945967 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be996e-c40c-41b8-9c8e-60f087061547 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:44.950479 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6489ee-ec16-448e-b3df-59f1e1a4c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:44.951064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6489ee-ec16-448e-b3df-59f1e1a4c949 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:44.951343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6489ee-ec16-448e-b3df-59f1e1a4c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:44.951613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6489ee-ec16-448e-b3df-59f1e1a4c949 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:44.952276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6489ee-ec16-448e-b3df-59f1e1a4c949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:27:44.952579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6489ee-ec16-448e-b3df-59f1e1a4c949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:44.954652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6489ee-ec16-448e-b3df-59f1e1a4c949 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:44.967540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1206/2403] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:27:44.979810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459e86-5c10-4623-8e3c-9b0017936b94 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:44.989121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459e86-5c10-4623-8e3c-9b0017936b94 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:44.994046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b69c-c5bd-4b0d-84a9-bbaa6896d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:44.994903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b69c-c5bd-4b0d-84a9-bbaa6896d564 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:44.995182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b69c-c5bd-4b0d-84a9-bbaa6896d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:44.995521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b69c-c5bd-4b0d-84a9-bbaa6896d564 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:44.996143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b69c-c5bd-4b0d-84a9-bbaa6896d564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:44.998455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b69c-c5bd-4b0d-84a9-bbaa6896d564 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:45.112507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1198/2404] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:27:44 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:27:45.116799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6489ee-ec16-448e-b3df-59f1e1a4c949 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:45.127727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6489ee-ec16-448e-b3df-59f1e1a4c949 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:45.160373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:45.182788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdd60a-07cd-4f15-bb7e-02d1cd674b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:45.183386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdd60a-07cd-4f15-bb7e-02d1cd674b4d admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:45.183660 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdd60a-07cd-4f15-bb7e-02d1cd674b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:45.183928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdd60a-07cd-4f15-bb7e-02d1cd674b4d admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:45.184590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdd60a-07cd-4f15-bb7e-02d1cd674b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:45.186471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdd60a-07cd-4f15-bb7e-02d1cd674b4d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:45.272125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1207/2405] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:27:45 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:27:45.279359 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b69c-c5bd-4b0d-84a9-bbaa6896d564 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:45.289982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b69c-c5bd-4b0d-84a9-bbaa6896d564 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:45.294609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14ec73-d8a6-4b7e-bd74-d401c075f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:45.295209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14ec73-d8a6-4b7e-bd74-d401c075f74e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:45.295490 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14ec73-d8a6-4b7e-bd74-d401c075f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:45.295764 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14ec73-d8a6-4b7e-bd74-d401c075f74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:45.296445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14ec73-d8a6-4b7e-bd74-d401c075f74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:45.298166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14ec73-d8a6-4b7e-bd74-d401c075f74e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:45.311942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1199/2406] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:27:45.313630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdd60a-07cd-4f15-bb7e-02d1cd674b4d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:45.324731 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdd60a-07cd-4f15-bb7e-02d1cd674b4d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:45.330237 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2de7d1-80e1-4e7e-868d-dcb2ef33be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:45.330841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2de7d1-80e1-4e7e-868d-dcb2ef33be93 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:45.331118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2de7d1-80e1-4e7e-868d-dcb2ef33be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:45.331389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2de7d1-80e1-4e7e-868d-dcb2ef33be93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:45.332308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2de7d1-80e1-4e7e-868d-dcb2ef33be93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:45.333961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2de7d1-80e1-4e7e-868d-dcb2ef33be93 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:45.344447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1208/2407] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:27:45.348750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14ec73-d8a6-4b7e-bd74-d401c075f74e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:45.358798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14ec73-d8a6-4b7e-bd74-d401c075f74e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:45.363444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d7fea-8849-4609-b39e-766fb8021be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:45.364091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7fea-8849-4609-b39e-766fb8021be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:45.364409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7fea-8849-4609-b39e-766fb8021be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:45.364685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7fea-8849-4609-b39e-766fb8021be5 admin admin] PATH_INFO: `/v3/projects/3bf3ac9ca92244c992dddfb1843c6021/users/e24df22250b4467fbc8d43f19e1350aa/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:45.380028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d7fea-8849-4609-b39e-766fb8021be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf3ac9ca92244c992dddfb1843c6021, user_id=e24df22250b4467fbc8d43f19e1350aa, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:45.382696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d7fea-8849-4609-b39e-766fb8021be5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:45.469900 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1200/2408] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:27:45 2022] PUT /identity/v3/projects/3bf3ac9ca92244c992dddfb1843c6021/users/e24df22250b4467fbc8d43f19e1350aa/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:27:45.485550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad332cf7-e551-466d-a59b-e7e2120e3fd3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:45.485959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad332cf7-e551-466d-a59b-e7e2120e3fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:45.486244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad332cf7-e551-466d-a59b-e7e2120e3fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:45.515138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ad332cf7-e551-466d-a59b-e7e2120e3fd3 None None] MFA Rules not processed for user `e24df22250b4467fbc8d43f19e1350aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:45.516397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ad332cf7-e551-466d-a59b-e7e2120e3fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:45.580597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1209/2409] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:27:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:45.591134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d7fea-8849-4609-b39e-766fb8021be5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:45.592820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9e9d7fea-8849-4609-b39e-766fb8021be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:45.674179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d7fea-8849-4609-b39e-766fb8021be5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:45.677983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c56ac-0470-4ed5-97a5-ec5a7d9681af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:45.678597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c56ac-0470-4ed5-97a5-ec5a7d9681af service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:45.678880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c56ac-0470-4ed5-97a5-ec5a7d9681af service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:45.679155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c56ac-0470-4ed5-97a5-ec5a7d9681af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:45.689536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c56ac-0470-4ed5-97a5-ec5a7d9681af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:45.690782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c56ac-0470-4ed5-97a5-ec5a7d9681af service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:45.699897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1201/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:27:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:27:49.876241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad332cf7-e551-466d-a59b-e7e2120e3fd3 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:49.943808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad332cf7-e551-466d-a59b-e7e2120e3fd3 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:49.948436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:49.949579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:49.949579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:49.949579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] PATH_INFO: `/v3/users/e24df22250b4467fbc8d43f19e1350aa` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:49.950919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24df22250b4467fbc8d43f19e1350aa)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:49.952888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:50.243734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24df22250b4467fbc8d43f19e1350aa'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:50.245217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:50.251338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24df22250b4467fbc8d43f19e1350aa'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:50.252002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24df22250b4467fbc8d43f19e1350aa'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:50.349221 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24df22250b4467fbc8d43f19e1350aa'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:50.365337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24df22250b4467fbc8d43f19e1350aa'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:50.371701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1210/2411] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:27:49 2022] DELETE /identity/v3/users/e24df22250b4467fbc8d43f19e1350aa => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:27:50.376224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32d565-a2cc-4a14-a0d2-062dd936ab98 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:50.376691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32d565-a2cc-4a14-a0d2-062dd936ab98 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:50.376789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32d565-a2cc-4a14-a0d2-062dd936ab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:50.396278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0e32d565-a2cc-4a14-a0d2-062dd936ab98 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:50.397428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e32d565-a2cc-4a14-a0d2-062dd936ab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:50.421843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:50.456664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1202/2412] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:50.466680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:50.468160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:50.547211 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c0756-41fd-4117-b150-3a12297ad9dd admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:50.551569 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e08f41-0219-47c8-866c-1153a9a40d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:50.552175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08f41-0219-47c8-866c-1153a9a40d9c service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:50.552481 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08f41-0219-47c8-866c-1153a9a40d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:50.552751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08f41-0219-47c8-866c-1153a9a40d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:50.561868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e08f41-0219-47c8-866c-1153a9a40d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:50.563287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e08f41-0219-47c8-866c-1153a9a40d9c service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:50.572595 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1211/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:27:51.061075 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32d565-a2cc-4a14-a0d2-062dd936ab98 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:51.062745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e32d565-a2cc-4a14-a0d2-062dd936ab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:51.075233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32d565-a2cc-4a14-a0d2-062dd936ab98 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:51.080386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:51.081241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:51.081525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:51.081800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] PATH_INFO: `/v3/projects/3bf3ac9ca92244c992dddfb1843c6021` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:51.082939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf3ac9ca92244c992dddfb1843c6021)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:51.084883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:51.226346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf3ac9ca92244c992dddfb1843c6021', 'request_id': 'req-4109f001-a841-4495-bba1-8f0a1634e63f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:51.232929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf3ac9ca92244c992dddfb1843c6021', 'request_id': 'req-4109f001-a841-4495-bba1-8f0a1634e63f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:51.239313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf3ac9ca92244c992dddfb1843c6021', 'request_id': 'req-4109f001-a841-4495-bba1-8f0a1634e63f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:51.321962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] The token cache is being invalidate because project 3bf3ac9ca92244c992dddfb1843c6021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:27:51.322261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:51.322885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4109f001-a841-4495-bba1-8f0a1634e63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:51.324480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1203/2414] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:27:51 2022] DELETE /identity/v3/projects/3bf3ac9ca92244c992dddfb1843c6021 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:27:51.329552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9b08-6aec-41ab-ac87-c8c717ad8162 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:51.334585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9b08-6aec-41ab-ac87-c8c717ad8162 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:51.334585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9b08-6aec-41ab-ac87-c8c717ad8162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:51.353143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-dbdb9b08-6aec-41ab-ac87-c8c717ad8162 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:51.354347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-dbdb9b08-6aec-41ab-ac87-c8c717ad8162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:51.414368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1212/2415] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:51.422247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b23b8-96dc-4b02-874c-2c2ab24bdd01 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:51.422743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b23b8-96dc-4b02-874c-2c2ab24bdd01 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:51.422869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b23b8-96dc-4b02-874c-2c2ab24bdd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:51.451458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fe3b23b8-96dc-4b02-874c-2c2ab24bdd01 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:51.452640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fe3b23b8-96dc-4b02-874c-2c2ab24bdd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:51.461064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1204/2416] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:51.465402 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9b08-6aec-41ab-ac87-c8c717ad8162 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:51.475791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9b08-6aec-41ab-ac87-c8c717ad8162 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:51.480423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65e9b6-177e-4eac-b665-0dd9966f67fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:51.481015 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e9b6-177e-4eac-b665-0dd9966f67fe admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:51.481299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e9b6-177e-4eac-b665-0dd9966f67fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:51.481570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e9b6-177e-4eac-b665-0dd9966f67fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:51.482213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65e9b6-177e-4eac-b665-0dd9966f67fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:27:51.482514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65e9b6-177e-4eac-b665-0dd9966f67fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:51.484097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65e9b6-177e-4eac-b665-0dd9966f67fe admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:51.500832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1213/2417] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:27:51.505618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b23b8-96dc-4b02-874c-2c2ab24bdd01 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:51.514982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b23b8-96dc-4b02-874c-2c2ab24bdd01 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:51.520228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454bc78-65ea-4ce8-a46f-c025560ccebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:51.520843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454bc78-65ea-4ce8-a46f-c025560ccebc admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:51.521120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454bc78-65ea-4ce8-a46f-c025560ccebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:51.521393 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454bc78-65ea-4ce8-a46f-c025560ccebc admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:51.522026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454bc78-65ea-4ce8-a46f-c025560ccebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:51.523926 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454bc78-65ea-4ce8-a46f-c025560ccebc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:51.650473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1205/2418] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:27:51 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:27:51.654640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65e9b6-177e-4eac-b665-0dd9966f67fe admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:51.665269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65e9b6-177e-4eac-b665-0dd9966f67fe admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:51.697977 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:51.723295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927f26-f25c-4475-aa3b-056cda20db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:51.723831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927f26-f25c-4475-aa3b-056cda20db23 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:51.724113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927f26-f25c-4475-aa3b-056cda20db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:51.724419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927f26-f25c-4475-aa3b-056cda20db23 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:51.725063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f927f26-f25c-4475-aa3b-056cda20db23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:51.726982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f927f26-f25c-4475-aa3b-056cda20db23 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:51.814958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1214/2419] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:27:51 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:27:51.819027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454bc78-65ea-4ce8-a46f-c025560ccebc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:51.829483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454bc78-65ea-4ce8-a46f-c025560ccebc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:51.834712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bc8c4-1ef3-434b-862e-ee708dabd9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:51.835303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bc8c4-1ef3-434b-862e-ee708dabd9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:51.835583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bc8c4-1ef3-434b-862e-ee708dabd9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:51.835857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bc8c4-1ef3-434b-862e-ee708dabd9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:51.836541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bc8c4-1ef3-434b-862e-ee708dabd9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:51.838114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bc8c4-1ef3-434b-862e-ee708dabd9b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:51.847948 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1206/2420] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:27:51.851749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927f26-f25c-4475-aa3b-056cda20db23 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:51.862190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927f26-f25c-4475-aa3b-056cda20db23 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:51.866894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e021f-d911-4b55-a86b-ca2687083d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:51.869377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e021f-d911-4b55-a86b-ca2687083d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:51.869377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e021f-d911-4b55-a86b-ca2687083d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:51.869377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e021f-d911-4b55-a86b-ca2687083d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:51.869377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e021f-d911-4b55-a86b-ca2687083d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:51.870684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e021f-d911-4b55-a86b-ca2687083d5f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:51.881279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1215/2421] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:27:51.885161 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bc8c4-1ef3-434b-862e-ee708dabd9b6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:51.896981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bc8c4-1ef3-434b-862e-ee708dabd9b6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:51.901765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4995a-0dfb-4f88-992c-5540fe536a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:51.902440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4995a-0dfb-4f88-992c-5540fe536a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:51.902718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4995a-0dfb-4f88-992c-5540fe536a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:51.902992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4995a-0dfb-4f88-992c-5540fe536a87 admin admin] PATH_INFO: `/v3/projects/a56a7e39fcc14e43891f9dfe92205a95/users/f3e64c1120574d2eaa98616e66de5c9d/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:51.918333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4995a-0dfb-4f88-992c-5540fe536a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56a7e39fcc14e43891f9dfe92205a95, user_id=f3e64c1120574d2eaa98616e66de5c9d, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:51.921028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4995a-0dfb-4f88-992c-5540fe536a87 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:52.023671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1207/2422] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:27:51 2022] PUT /identity/v3/projects/a56a7e39fcc14e43891f9dfe92205a95/users/f3e64c1120574d2eaa98616e66de5c9d/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:27:52.036846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253c3a-a430-4c08-a83b-0e7970128031 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:52.036846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253c3a-a430-4c08-a83b-0e7970128031 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:52.036846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253c3a-a430-4c08-a83b-0e7970128031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:52.071725 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c8253c3a-a430-4c08-a83b-0e7970128031 None None] MFA Rules not processed for user `f3e64c1120574d2eaa98616e66de5c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:52.072982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c8253c3a-a430-4c08-a83b-0e7970128031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:52.154782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1216/2423] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:27:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:52.167167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4995a-0dfb-4f88-992c-5540fe536a87 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:52.168967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59a4995a-0dfb-4f88-992c-5540fe536a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:52.223817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:52.227426 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4995a-0dfb-4f88-992c-5540fe536a87 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:52.231479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b6735-4017-4126-9cc7-52bc701341a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:52.232117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6735-4017-4126-9cc7-52bc701341a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:52.232431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6735-4017-4126-9cc7-52bc701341a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:52.232702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6735-4017-4126-9cc7-52bc701341a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:52.244485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b6735-4017-4126-9cc7-52bc701341a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:52.244485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b6735-4017-4126-9cc7-52bc701341a4 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:52.252372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1208/2424] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:27:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:27:52.277711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253c3a-a430-4c08-a83b-0e7970128031 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:52.341599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253c3a-a430-4c08-a83b-0e7970128031 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:52.346249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:52.346884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:52.347163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:52.347435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] PATH_INFO: `/v3/users/f3e64c1120574d2eaa98616e66de5c9d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:52.348598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e64c1120574d2eaa98616e66de5c9d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:52.350512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:52.549762 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:27:52.551297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e64c1120574d2eaa98616e66de5c9d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:52.558027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e64c1120574d2eaa98616e66de5c9d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:52.558708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e64c1120574d2eaa98616e66de5c9d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:52.631649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e64c1120574d2eaa98616e66de5c9d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:52.644599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e64c1120574d2eaa98616e66de5c9d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:52.650864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1217/2425] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:27:52 2022] DELETE /identity/v3/users/f3e64c1120574d2eaa98616e66de5c9d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:27:52.655276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a7da-da5b-4dc4-b3ce-93a7b58b002b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:52.655800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a7da-da5b-4dc4-b3ce-93a7b58b002b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:52.655996 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a7da-da5b-4dc4-b3ce-93a7b58b002b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:52.675856 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5aa5a7da-da5b-4dc4-b3ce-93a7b58b002b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:52.677094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5aa5a7da-da5b-4dc4-b3ce-93a7b58b002b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:52.738463 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1209/2426] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:52.748012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:52.749551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:52.807904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb4890-f0af-4646-aa67-d8aabfe3af9b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:52.811907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccc867-3d3c-4d52-8328-8aae0ef5648d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:52.812553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccc867-3d3c-4d52-8328-8aae0ef5648d service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:52.812837 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccc867-3d3c-4d52-8328-8aae0ef5648d service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:52.813114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccc867-3d3c-4d52-8328-8aae0ef5648d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:52.822474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccc867-3d3c-4d52-8328-8aae0ef5648d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:52.823895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccc867-3d3c-4d52-8328-8aae0ef5648d service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:52.834627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1218/2427] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:27:53.285438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5a7da-da5b-4dc4-b3ce-93a7b58b002b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:53.288534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5aa5a7da-da5b-4dc4-b3ce-93a7b58b002b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:53.313331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5a7da-da5b-4dc4-b3ce-93a7b58b002b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:53.322092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:53.322755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:53.323613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:53.323898 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] PATH_INFO: `/v3/projects/a56a7e39fcc14e43891f9dfe92205a95` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:53.325792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56a7e39fcc14e43891f9dfe92205a95)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:53.328741 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:53.463736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56a7e39fcc14e43891f9dfe92205a95', 'request_id': 'req-b39507ab-adc3-41e8-bbbd-82014b37cc87'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:53.470433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56a7e39fcc14e43891f9dfe92205a95', 'request_id': 'req-b39507ab-adc3-41e8-bbbd-82014b37cc87'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:53.477029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56a7e39fcc14e43891f9dfe92205a95', 'request_id': 'req-b39507ab-adc3-41e8-bbbd-82014b37cc87'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:53.573844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] The token cache is being invalidate because project a56a7e39fcc14e43891f9dfe92205a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:27:53.574132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:53.574752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:27:53.576377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1210/2428] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:27:53 2022] DELETE /identity/v3/projects/a56a7e39fcc14e43891f9dfe92205a95 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:27:54.564589 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829613d8-f4fc-4b38-8fe2-fd019cea1472 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:54.565078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829613d8-f4fc-4b38-8fe2-fd019cea1472 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:54.565178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829613d8-f4fc-4b38-8fe2-fd019cea1472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:54.584676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-829613d8-f4fc-4b38-8fe2-fd019cea1472 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:27:54.585869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-829613d8-f4fc-4b38-8fe2-fd019cea1472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:54.639518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1219/2429] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:27:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:27:54.654026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:27:54.655989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:27:54.727580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39507ab-adc3-41e8-bbbd-82014b37cc87 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:27:54.732546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a93611-fb6e-4742-ab3c-a52ecd5d1bd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:27:54.733270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93611-fb6e-4742-ab3c-a52ecd5d1bd7 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:27:54.733422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93611-fb6e-4742-ab3c-a52ecd5d1bd7 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:27:54.733687 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93611-fb6e-4742-ab3c-a52ecd5d1bd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:27:54.741590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a93611-fb6e-4742-ab3c-a52ecd5d1bd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:27:54.743155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a93611-fb6e-4742-ab3c-a52ecd5d1bd7 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:27:54.751584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1211/2430] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:27:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:28:04.632852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=64,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:04.748138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:16.386482 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5f5b-e15a-4d9b-9962-9ff196274a16 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:16.387100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5f5b-e15a-4d9b-9962-9ff196274a16 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:16.387208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5f5b-e15a-4d9b-9962-9ff196274a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:16.406829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ddaa5f5b-e15a-4d9b-9962-9ff196274a16 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:16.408039 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ddaa5f5b-e15a-4d9b-9962-9ff196274a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:16.416066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1220/2431] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 1 12:28:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:16.428140 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a93611-fb6e-4742-ab3c-a52ecd5d1bd7 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:16.438719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a93611-fb6e-4742-ab3c-a52ecd5d1bd7 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:16.443833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf280a0a-0d00-4cae-a187-4ee7c68baee1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:16.444544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf280a0a-0d00-4cae-a187-4ee7c68baee1 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:16.444830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf280a0a-0d00-4cae-a187-4ee7c68baee1 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:16.445107 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf280a0a-0d00-4cae-a187-4ee7c68baee1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:16.453560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf280a0a-0d00-4cae-a187-4ee7c68baee1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:16.455131 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf280a0a-0d00-4cae-a187-4ee7c68baee1 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:16.463936 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1212/2432] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:28:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:28:26.041042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa5f5b-e15a-4d9b-9962-9ff196274a16 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:26.042458 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ddaa5f5b-e15a-4d9b-9962-9ff196274a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:26.098107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa5f5b-e15a-4d9b-9962-9ff196274a16 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:26.101661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f517738-f82c-40bb-a1fd-5e259da1244a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:26.102262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517738-f82c-40bb-a1fd-5e259da1244a service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:26.102544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517738-f82c-40bb-a1fd-5e259da1244a service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:26.102821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f517738-f82c-40bb-a1fd-5e259da1244a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:26.104555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0f517738-f82c-40bb-a1fd-5e259da1244a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:26.161887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f517738-f82c-40bb-a1fd-5e259da1244a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:26.163333 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f517738-f82c-40bb-a1fd-5e259da1244a service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:26.172082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1221/2433] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:28:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:28:26.460105 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:32.787192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf280a0a-0d00-4cae-a187-4ee7c68baee1 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:32.797347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf280a0a-0d00-4cae-a187-4ee7c68baee1 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:32.802264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb16f7b-162e-4562-8928-4f82dede8644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:32.802264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb16f7b-162e-4562-8928-4f82dede8644 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:32.802264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb16f7b-162e-4562-8928-4f82dede8644 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:32.802264 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb16f7b-162e-4562-8928-4f82dede8644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:32.803919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1cb16f7b-162e-4562-8928-4f82dede8644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:32.875048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb16f7b-162e-4562-8928-4f82dede8644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:32.876560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb16f7b-162e-4562-8928-4f82dede8644 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:32.886189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1213/2434] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:28:36.168087 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=51 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:36.832618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f517738-f82c-40bb-a1fd-5e259da1244a service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:36.841957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f517738-f82c-40bb-a1fd-5e259da1244a service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:36.845664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8a2b5-6f14-4aa9-83f0-d90e053796f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:36.846264 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a2b5-6f14-4aa9-83f0-d90e053796f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:36.846544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a2b5-6f14-4aa9-83f0-d90e053796f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:36.846815 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a2b5-6f14-4aa9-83f0-d90e053796f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:36.848574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-91d8a2b5-6f14-4aa9-83f0-d90e053796f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:36.861556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a2b5-6f14-4aa9-83f0-d90e053796f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:36.865549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a2b5-6f14-4aa9-83f0-d90e053796f4 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:36.873210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1222/2435] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:28:41.156696 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb16f7b-162e-4562-8928-4f82dede8644 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:41.159954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1cb16f7b-162e-4562-8928-4f82dede8644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:41.171733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb16f7b-162e-4562-8928-4f82dede8644 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:41.176202 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:41.176894 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:41.177495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:41.177759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] PATH_INFO: `/v3/users/b66719801f8e4c56a7fc0208704d538f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:41.178060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8a2b5-6f14-4aa9-83f0-d90e053796f4 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:41.178928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66719801f8e4c56a7fc0208704d538f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:41.179510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-91d8a2b5-6f14-4aa9-83f0-d90e053796f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:41.181417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:41.194760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8a2b5-6f14-4aa9-83f0-d90e053796f4 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:41.200066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:41.200746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:41.201082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:41.201360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] PATH_INFO: `/v3/users/84cdb167f7ce4bc081ce4d5e60841061` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:41.202665 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84cdb167f7ce4bc081ce4d5e60841061)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:41.204691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:41.398933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66719801f8e4c56a7fc0208704d538f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:41.406067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66719801f8e4c56a7fc0208704d538f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:41.424394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84cdb167f7ce4bc081ce4d5e60841061'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:41.432909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84cdb167f7ce4bc081ce4d5e60841061'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:41.432909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84cdb167f7ce4bc081ce4d5e60841061'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:41.479593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66719801f8e4c56a7fc0208704d538f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:41.480255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66719801f8e4c56a7fc0208704d538f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:41.480869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66719801f8e4c56a7fc0208704d538f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:41.499786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1214/2436] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:28:41 2022] DELETE /identity/v3/users/b66719801f8e4c56a7fc0208704d538f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:41.539969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84cdb167f7ce4bc081ce4d5e60841061'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:41.553355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84cdb167f7ce4bc081ce4d5e60841061'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:41.560705 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1223/2437] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:28:41 2022] DELETE /identity/v3/users/84cdb167f7ce4bc081ce4d5e60841061 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:28:41.801402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:41.803043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:41.874718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:41.876510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:41.902886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf04bfb-be39-4edd-aa34-038a8955668c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:41.919085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:41.975155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:41.975735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:41.987139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:41.987139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] PATH_INFO: `/v3/projects/4bb99fe4d3e34f9e8eb05fc173ea2d78` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:41.987139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb99fe4d3e34f9e8eb05fc173ea2d78)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:41.987139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:41.987535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92697b02-b654-42be-b12c-c9bde152ee65 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:41.989552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:41.990174 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:41.990450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:41.990719 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] PATH_INFO: `/v3/projects/4c471f5ced7e4ce09a990717c776e483` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:41.991830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c471f5ced7e4ce09a990717c776e483)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:41.994494 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:42.135184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c471f5ced7e4ce09a990717c776e483', 'request_id': 'req-62438191-cd4b-48d6-bab1-b7b45a4ebe40'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.136255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb99fe4d3e34f9e8eb05fc173ea2d78', 'request_id': 'req-83c819e7-d066-4809-a73e-967cdf0d4447'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.141485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c471f5ced7e4ce09a990717c776e483', 'request_id': 'req-62438191-cd4b-48d6-bab1-b7b45a4ebe40'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.143934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb99fe4d3e34f9e8eb05fc173ea2d78', 'request_id': 'req-83c819e7-d066-4809-a73e-967cdf0d4447'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.149822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb99fe4d3e34f9e8eb05fc173ea2d78', 'request_id': 'req-83c819e7-d066-4809-a73e-967cdf0d4447'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.210265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c471f5ced7e4ce09a990717c776e483', 'request_id': 'req-62438191-cd4b-48d6-bab1-b7b45a4ebe40'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.211515 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:42.221239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] The token cache is being invalidate because project 4c471f5ced7e4ce09a990717c776e483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:28:42.221559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.222181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.223667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1224/2438] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:28:41 2022] DELETE /identity/v3/projects/4c471f5ced7e4ce09a990717c776e483 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:42.228105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:42.229401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:42.290523 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62438191-cd4b-48d6-bab1-b7b45a4ebe40 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:42.296500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] The token cache is being invalidate because project 4bb99fe4d3e34f9e8eb05fc173ea2d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:28:42.296975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.297467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-83c819e7-d066-4809-a73e-967cdf0d4447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.298986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1215/2439] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:28:41 2022] DELETE /identity/v3/projects/4bb99fe4d3e34f9e8eb05fc173ea2d78 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:42.303832 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a630-e9b1-4617-a345-07b98fdf9c16 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:42.304115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a630-e9b1-4617-a345-07b98fdf9c16 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:42.304547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04a630-e9b1-4617-a345-07b98fdf9c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:42.324256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9d04a630-e9b1-4617-a345-07b98fdf9c16 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:42.325453 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d04a630-e9b1-4617-a345-07b98fdf9c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:42.347593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:42.348258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:42.348546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:42.348828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] PATH_INFO: `/v3/users/c69ca9df4e9641de9d99ad69278b1fdc` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:42.349986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69ca9df4e9641de9d99ad69278b1fdc)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:42.352526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:42.390916 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1216/2440] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:42.398812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea837086-3c2d-4378-9c83-604d6329df82 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:42.399095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea837086-3c2d-4378-9c83-604d6329df82 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:42.399367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea837086-3c2d-4378-9c83-604d6329df82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:42.420149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ea837086-3c2d-4378-9c83-604d6329df82 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:42.421444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ea837086-3c2d-4378-9c83-604d6329df82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:42.429331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1217/2441] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:28:42.434045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea837086-3c2d-4378-9c83-604d6329df82 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:42.442758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea837086-3c2d-4378-9c83-604d6329df82 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:42.447876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934112d-cfa0-4211-90ed-5a51690b5268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:42.448483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934112d-cfa0-4211-90ed-5a51690b5268 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:42.448762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934112d-cfa0-4211-90ed-5a51690b5268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:42.449038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934112d-cfa0-4211-90ed-5a51690b5268 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:42.449670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934112d-cfa0-4211-90ed-5a51690b5268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:28:42.449973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934112d-cfa0-4211-90ed-5a51690b5268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:42.451601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934112d-cfa0-4211-90ed-5a51690b5268 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:42.463602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1218/2442] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:28:42.467661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934112d-cfa0-4211-90ed-5a51690b5268 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:42.477208 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934112d-cfa0-4211-90ed-5a51690b5268 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:42.481869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfe0dd-01c7-4614-99e9-1df1f566b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:42.482429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfe0dd-01c7-4614-99e9-1df1f566b5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:42.482714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfe0dd-01c7-4614-99e9-1df1f566b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:42.483017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfe0dd-01c7-4614-99e9-1df1f566b5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:42.483630 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfe0dd-01c7-4614-99e9-1df1f566b5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:42.485658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfe0dd-01c7-4614-99e9-1df1f566b5c2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:42.535773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69ca9df4e9641de9d99ad69278b1fdc'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.542869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69ca9df4e9641de9d99ad69278b1fdc'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.543559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69ca9df4e9641de9d99ad69278b1fdc'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.591500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1219/2443] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:28:42 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:28:42.595521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfe0dd-01c7-4614-99e9-1df1f566b5c2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:42.599545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:42.619788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69ca9df4e9641de9d99ad69278b1fdc'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.632806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69ca9df4e9641de9d99ad69278b1fdc'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:42.640334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1225/2444] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:28:42 2022] DELETE /identity/v3/users/c69ca9df4e9641de9d99ad69278b1fdc => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:28:42.662825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfe0dd-01c7-4614-99e9-1df1f566b5c2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:42.720970 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4f558-977e-4230-8feb-139f047c1750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:42.721693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4f558-977e-4230-8feb-139f047c1750 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:42.721959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4f558-977e-4230-8feb-139f047c1750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:42.722231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4f558-977e-4230-8feb-139f047c1750 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:42.722882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4f558-977e-4230-8feb-139f047c1750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:42.724909 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4f558-977e-4230-8feb-139f047c1750 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:42.808166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1220/2445] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:28:42 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:28:42.812162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:42.813638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:42.827046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b91a-f975-45bd-b559-924f7e11d36b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:42.831829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd925f-bb43-493e-91fc-30a6a0528c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:42.832486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd925f-bb43-493e-91fc-30a6a0528c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:42.832774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd925f-bb43-493e-91fc-30a6a0528c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:42.833045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd925f-bb43-493e-91fc-30a6a0528c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:42.833718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd925f-bb43-493e-91fc-30a6a0528c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:42.835444 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd925f-bb43-493e-91fc-30a6a0528c7f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:42.845503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1226/2446] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:42.849435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4f558-977e-4230-8feb-139f047c1750 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:42.859504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4f558-977e-4230-8feb-139f047c1750 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:42.864376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06685655-b510-4ae2-bace-f1f87d55553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:42.864973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685655-b510-4ae2-bace-f1f87d55553d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:42.865253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685655-b510-4ae2-bace-f1f87d55553d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:42.865525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685655-b510-4ae2-bace-f1f87d55553d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:42.866173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06685655-b510-4ae2-bace-f1f87d55553d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:42.868895 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06685655-b510-4ae2-bace-f1f87d55553d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:42.873494 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd925f-bb43-493e-91fc-30a6a0528c7f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:42.873494 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9afd925f-bb43-493e-91fc-30a6a0528c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:42.881478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:42.885693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1221/2447] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:42.886014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd925f-bb43-493e-91fc-30a6a0528c7f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:42.886805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06685655-b510-4ae2-bace-f1f87d55553d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:42.891152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:42.891794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:42.892139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:42.892394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] PATH_INFO: `/v3/projects/5464cba9f1104dac8492a5a6856048c0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:42.893599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5464cba9f1104dac8492a5a6856048c0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:42.895605 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:42.908350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06685655-b510-4ae2-bace-f1f87d55553d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:42.908350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f621f-0ad7-406c-a41b-6ad58ce29736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:42.908350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f621f-0ad7-406c-a41b-6ad58ce29736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:42.908350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f621f-0ad7-406c-a41b-6ad58ce29736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:42.909128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f621f-0ad7-406c-a41b-6ad58ce29736 admin admin] PATH_INFO: `/v3/projects/6907b3fa59754735bb75fac7a1d3534c/users/89c699a1dd4d438894b54f5719547133/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:42.922395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f621f-0ad7-406c-a41b-6ad58ce29736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6907b3fa59754735bb75fac7a1d3534c, user_id=89c699a1dd4d438894b54f5719547133, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:42.925372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f621f-0ad7-406c-a41b-6ad58ce29736 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:43.014135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1222/2448] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:28:42 2022] PUT /identity/v3/projects/6907b3fa59754735bb75fac7a1d3534c/users/89c699a1dd4d438894b54f5719547133/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:43.021679 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5464cba9f1104dac8492a5a6856048c0', 'request_id': 'req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:43.029565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5464cba9f1104dac8492a5a6856048c0', 'request_id': 'req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:43.038089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614f4b-d016-40ec-a9b4-5cebada32bac None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:43.038380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614f4b-d016-40ec-a9b4-5cebada32bac None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:43.038660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614f4b-d016-40ec-a9b4-5cebada32bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:43.069020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4c614f4b-d016-40ec-a9b4-5cebada32bac None None] MFA Rules not processed for user `89c699a1dd4d438894b54f5719547133`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:43.070432 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4c614f4b-d016-40ec-a9b4-5cebada32bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:43.110209 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5464cba9f1104dac8492a5a6856048c0', 'request_id': 'req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:43.122432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] The token cache is being invalidate because project 5464cba9f1104dac8492a5a6856048c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:28:43.122723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:43.123373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:43.126193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:43.136648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1227/2449] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:28:42 2022] DELETE /identity/v3/projects/5464cba9f1104dac8492a5a6856048c0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:43.137081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1223/2450] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:43.153347 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:43.157094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:43.272437 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9cfc1-43c4-4f4d-b7c1-89171b60f05a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:43.279011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2fdf1-25ac-4c54-a992-5f796204adba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:43.279744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2fdf1-25ac-4c54-a992-5f796204adba service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:43.280100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2fdf1-25ac-4c54-a992-5f796204adba service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:43.280477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2fdf1-25ac-4c54-a992-5f796204adba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:43.282474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7aa2fdf1-25ac-4c54-a992-5f796204adba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:43.294730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2fdf1-25ac-4c54-a992-5f796204adba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:43.296550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2fdf1-25ac-4c54-a992-5f796204adba service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:43.307343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1228/2451] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:28:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:28:43.536040 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614f4b-d016-40ec-a9b4-5cebada32bac None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:43.598116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614f4b-d016-40ec-a9b4-5cebada32bac None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:43.602666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:43.603881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:43.604171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:43.604472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] PATH_INFO: `/v3/users/89c699a1dd4d438894b54f5719547133` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:43.605663 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c699a1dd4d438894b54f5719547133)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:43.607612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:43.775013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c699a1dd4d438894b54f5719547133'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:43.782660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c699a1dd4d438894b54f5719547133'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:43.841721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c699a1dd4d438894b54f5719547133'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:43.842358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c699a1dd4d438894b54f5719547133'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:43.842967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c699a1dd4d438894b54f5719547133'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:43.860937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1224/2452] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:28:43 2022] DELETE /identity/v3/users/89c699a1dd4d438894b54f5719547133 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:43.865452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0991d-b1f4-4ede-be03-08c9695648db None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:43.865740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0991d-b1f4-4ede-be03-08c9695648db None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:43.866010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0991d-b1f4-4ede-be03-08c9695648db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:43.885487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bdb0991d-b1f4-4ede-be03-08c9695648db None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:43.886695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bdb0991d-b1f4-4ede-be03-08c9695648db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:43.934348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:43.946314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1229/2453] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:43.956525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:43.958005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:44.015985 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20f26d-a12b-4026-ad9d-3814dd63a585 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:44.019698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c53e-836f-44e5-ad97-e26d67ba6a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:44.020395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c53e-836f-44e5-ad97-e26d67ba6a25 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:44.020678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c53e-836f-44e5-ad97-e26d67ba6a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:44.020956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c53e-836f-44e5-ad97-e26d67ba6a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:44.029851 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0c53e-836f-44e5-ad97-e26d67ba6a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:44.031212 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0c53e-836f-44e5-ad97-e26d67ba6a25 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:44.040537 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1225/2454] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:28:44.438108 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0991d-b1f4-4ede-be03-08c9695648db None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:44.439549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bdb0991d-b1f4-4ede-be03-08c9695648db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:44.453142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0991d-b1f4-4ede-be03-08c9695648db None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:44.457954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:44.458606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:44.458869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:44.459139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] PATH_INFO: `/v3/projects/6907b3fa59754735bb75fac7a1d3534c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:44.460284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6907b3fa59754735bb75fac7a1d3534c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:44.462822 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:44.582496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6907b3fa59754735bb75fac7a1d3534c', 'request_id': 'req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:44.588634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6907b3fa59754735bb75fac7a1d3534c', 'request_id': 'req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:44.664701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6907b3fa59754735bb75fac7a1d3534c', 'request_id': 'req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:44.676051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] The token cache is being invalidate because project 6907b3fa59754735bb75fac7a1d3534c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:28:44.681279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:44.681279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c9f99c2c-dfdd-4891-b5a2-446feee8b6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:44.681279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1230/2455] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:28:44 2022] DELETE /identity/v3/projects/6907b3fa59754735bb75fac7a1d3534c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:44.684127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08839c-d8f4-4907-b207-98b785759e02 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:44.684641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08839c-d8f4-4907-b207-98b785759e02 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:44.684749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08839c-d8f4-4907-b207-98b785759e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:44.704335 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1d08839c-d8f4-4907-b207-98b785759e02 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:44.705496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d08839c-d8f4-4907-b207-98b785759e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:44.715277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:44.763776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1226/2456] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:44.771744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20345bd4-f80b-4d2f-ab39-1e0c646d105d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:44.773024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20345bd4-f80b-4d2f-ab39-1e0c646d105d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:44.773024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20345bd4-f80b-4d2f-ab39-1e0c646d105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:44.791918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-20345bd4-f80b-4d2f-ab39-1e0c646d105d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:44.793184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-20345bd4-f80b-4d2f-ab39-1e0c646d105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:44.801406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1231/2457] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:28:44.805637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08839c-d8f4-4907-b207-98b785759e02 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:44.815434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08839c-d8f4-4907-b207-98b785759e02 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:44.819915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8c332-1008-4111-966f-727bd60bd580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:44.820531 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8c332-1008-4111-966f-727bd60bd580 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:44.820814 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8c332-1008-4111-966f-727bd60bd580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:44.821084 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8c332-1008-4111-966f-727bd60bd580 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:44.821726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8c332-1008-4111-966f-727bd60bd580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:28:44.822659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8c332-1008-4111-966f-727bd60bd580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:44.824259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8c332-1008-4111-966f-727bd60bd580 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:44.836256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1227/2458] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:28:44.839839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20345bd4-f80b-4d2f-ab39-1e0c646d105d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:44.849024 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20345bd4-f80b-4d2f-ab39-1e0c646d105d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:44.854088 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301e91-cf01-44d8-ad8b-4df5f4cb473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:44.854687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301e91-cf01-44d8-ad8b-4df5f4cb473e admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:44.854982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301e91-cf01-44d8-ad8b-4df5f4cb473e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:44.855242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301e91-cf01-44d8-ad8b-4df5f4cb473e admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:44.855877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27301e91-cf01-44d8-ad8b-4df5f4cb473e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:44.858041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27301e91-cf01-44d8-ad8b-4df5f4cb473e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:44.931983 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1232/2459] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:28:44 2022] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:28:44.936193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8c332-1008-4111-966f-727bd60bd580 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:44.946213 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8c332-1008-4111-966f-727bd60bd580 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:45.002995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a380c-a81b-4941-af67-41639ac89498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:45.003593 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a380c-a81b-4941-af67-41639ac89498 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:45.003868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a380c-a81b-4941-af67-41639ac89498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:45.004145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a380c-a81b-4941-af67-41639ac89498 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:45.004818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a380c-a81b-4941-af67-41639ac89498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:45.006726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a380c-a81b-4941-af67-41639ac89498 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:45.116021 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1228/2460] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:28:44 2022] POST /identity/v3/users => generated 303 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:28:45.120994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301e91-cf01-44d8-ad8b-4df5f4cb473e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:45.131169 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301e91-cf01-44d8-ad8b-4df5f4cb473e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:45.135773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae0952-02d3-4aec-9bb9-3c9aa5c582a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:45.136393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae0952-02d3-4aec-9bb9-3c9aa5c582a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:45.136721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae0952-02d3-4aec-9bb9-3c9aa5c582a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:45.140723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae0952-02d3-4aec-9bb9-3c9aa5c582a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:45.140723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae0952-02d3-4aec-9bb9-3c9aa5c582a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:45.140723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae0952-02d3-4aec-9bb9-3c9aa5c582a2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:45.148913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1233/2461] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:45.152794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a380c-a81b-4941-af67-41639ac89498 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:45.162802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a380c-a81b-4941-af67-41639ac89498 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:45.168202 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cfb32-318b-419b-b491-458dbde2461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:45.168820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cfb32-318b-419b-b491-458dbde2461a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:45.169104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cfb32-318b-419b-b491-458dbde2461a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:45.169381 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cfb32-318b-419b-b491-458dbde2461a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:45.170020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cfb32-318b-419b-b491-458dbde2461a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:45.171603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cfb32-318b-419b-b491-458dbde2461a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:45.185679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1229/2462] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:45.190257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae0952-02d3-4aec-9bb9-3c9aa5c582a2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:45.200005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae0952-02d3-4aec-9bb9-3c9aa5c582a2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:45.204585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65b896-8e90-40a6-99c6-05adf7cd7bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:45.205221 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65b896-8e90-40a6-99c6-05adf7cd7bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:45.205499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65b896-8e90-40a6-99c6-05adf7cd7bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:45.205775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65b896-8e90-40a6-99c6-05adf7cd7bcf admin admin] PATH_INFO: `/v3/projects/07b5ad0fb5394bad8adf545e19ed83c3/users/459645a6a07640358f45c02b70ee7c05/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:45.219743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65b896-8e90-40a6-99c6-05adf7cd7bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b5ad0fb5394bad8adf545e19ed83c3, user_id=459645a6a07640358f45c02b70ee7c05, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:45.222474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65b896-8e90-40a6-99c6-05adf7cd7bcf admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:45.296220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1234/2463] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:28:45 2022] PUT /identity/v3/projects/07b5ad0fb5394bad8adf545e19ed83c3/users/459645a6a07640358f45c02b70ee7c05/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:28:45.308568 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c4556-8889-4652-b2a2-c3c632d2c9dd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:45.308920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c4556-8889-4652-b2a2-c3c632d2c9dd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:45.309207 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c4556-8889-4652-b2a2-c3c632d2c9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:45.337631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-608c4556-8889-4652-b2a2-c3c632d2c9dd None None] MFA Rules not processed for user `459645a6a07640358f45c02b70ee7c05`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:45.338837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-608c4556-8889-4652-b2a2-c3c632d2c9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:45.401046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1230/2464] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:28:45.405411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65b896-8e90-40a6-99c6-05adf7cd7bcf admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:45.465766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65b896-8e90-40a6-99c6-05adf7cd7bcf admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:45.470452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040961d-d0d1-47d1-9c8f-3bee7339c84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:45.471045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040961d-d0d1-47d1-9c8f-3bee7339c84c admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:45.471325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040961d-d0d1-47d1-9c8f-3bee7339c84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:45.471596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040961d-d0d1-47d1-9c8f-3bee7339c84c admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:45.472250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040961d-d0d1-47d1-9c8f-3bee7339c84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:45.474157 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040961d-d0d1-47d1-9c8f-3bee7339c84c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:45.619932 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:45.627165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1235/2465] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:28:45 2022] POST /identity/v3/projects => generated 403 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:28:45.631295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c4556-8889-4652-b2a2-c3c632d2c9dd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:45.642209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c4556-8889-4652-b2a2-c3c632d2c9dd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:45.650011 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:45.698374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b30ed3-574e-4c27-8cb1-f3727f46af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:45.698981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b30ed3-574e-4c27-8cb1-f3727f46af50 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:45.699257 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b30ed3-574e-4c27-8cb1-f3727f46af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:45.699527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b30ed3-574e-4c27-8cb1-f3727f46af50 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:45.700157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b30ed3-574e-4c27-8cb1-f3727f46af50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:45.702110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b30ed3-574e-4c27-8cb1-f3727f46af50 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:45.821919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1231/2466] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:28:45 2022] POST /identity/v3/users => generated 308 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:28:45.825889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040961d-d0d1-47d1-9c8f-3bee7339c84c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:45.835919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040961d-d0d1-47d1-9c8f-3bee7339c84c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:45.841031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2b9b-4b2f-4e2e-ac45-5b6a20334e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:45.841636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2b9b-4b2f-4e2e-ac45-5b6a20334e17 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:45.841914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2b9b-4b2f-4e2e-ac45-5b6a20334e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:45.842182 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2b9b-4b2f-4e2e-ac45-5b6a20334e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:45.842876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be2b9b-4b2f-4e2e-ac45-5b6a20334e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:45.844496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be2b9b-4b2f-4e2e-ac45-5b6a20334e17 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:45.855524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1236/2467] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:28:45.862146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b30ed3-574e-4c27-8cb1-f3727f46af50 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:45.872515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b30ed3-574e-4c27-8cb1-f3727f46af50 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:45.877117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79536-ead1-4d57-9f2a-f5022319a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:45.877885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79536-ead1-4d57-9f2a-f5022319a467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:45.878068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79536-ead1-4d57-9f2a-f5022319a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:45.878345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79536-ead1-4d57-9f2a-f5022319a467 admin admin] PATH_INFO: `/v3/projects/05f5fb08bad94c86a2a47015445cb759/users/3883b052faaa449989d6d80e5e9050d7/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:45.893745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c79536-ead1-4d57-9f2a-f5022319a467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f5fb08bad94c86a2a47015445cb759, user_id=3883b052faaa449989d6d80e5e9050d7, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:45.896511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c79536-ead1-4d57-9f2a-f5022319a467 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:45.970520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1232/2468] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:28:45 2022] PUT /identity/v3/projects/05f5fb08bad94c86a2a47015445cb759/users/3883b052faaa449989d6d80e5e9050d7/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:45.974417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2b9b-4b2f-4e2e-ac45-5b6a20334e17 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:45.984532 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2b9b-4b2f-4e2e-ac45-5b6a20334e17 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:46.041467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb6772-078e-486f-894d-a82a394bdef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:46.042068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb6772-078e-486f-894d-a82a394bdef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:46.042351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb6772-078e-486f-894d-a82a394bdef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:46.042630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb6772-078e-486f-894d-a82a394bdef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:46.043272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb6772-078e-486f-894d-a82a394bdef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:46.044893 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb6772-078e-486f-894d-a82a394bdef3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:46.054495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1237/2469] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:28:46.058646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79536-ead1-4d57-9f2a-f5022319a467 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:46.068741 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79536-ead1-4d57-9f2a-f5022319a467 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:46.073774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45ece0-1f21-4aa4-add9-0bfa8a1b6bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:46.074406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ece0-1f21-4aa4-add9-0bfa8a1b6bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:46.074681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ece0-1f21-4aa4-add9-0bfa8a1b6bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:46.074950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ece0-1f21-4aa4-add9-0bfa8a1b6bd7 admin admin] PATH_INFO: `/v3/projects/05f5fb08bad94c86a2a47015445cb759/users/3883b052faaa449989d6d80e5e9050d7/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:46.076830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45ece0-1f21-4aa4-add9-0bfa8a1b6bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f5fb08bad94c86a2a47015445cb759, user_id=3883b052faaa449989d6d80e5e9050d7, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:46.079403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45ece0-1f21-4aa4-add9-0bfa8a1b6bd7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:46.089859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1233/2470] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:28:46 2022] PUT /identity/v3/projects/05f5fb08bad94c86a2a47015445cb759/users/3883b052faaa449989d6d80e5e9050d7/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:46.100010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517df4c-02d9-463a-b91d-e1ea74ca1557 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:46.100340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517df4c-02d9-463a-b91d-e1ea74ca1557 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:46.100624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517df4c-02d9-463a-b91d-e1ea74ca1557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:46.127697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6517df4c-02d9-463a-b91d-e1ea74ca1557 None None] MFA Rules not processed for user `3883b052faaa449989d6d80e5e9050d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:46.128933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6517df4c-02d9-463a-b91d-e1ea74ca1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:46.196083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1238/2471] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:46.207263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45ece0-1f21-4aa4-add9-0bfa8a1b6bd7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:46.208964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a45ece0-1f21-4aa4-add9-0bfa8a1b6bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:46.265922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45ece0-1f21-4aa4-add9-0bfa8a1b6bd7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:46.269513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fc9bf-f2b6-4d76-a346-074c4b287941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:46.270110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fc9bf-f2b6-4d76-a346-074c4b287941 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:46.270388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fc9bf-f2b6-4d76-a346-074c4b287941 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:46.270659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fc9bf-f2b6-4d76-a346-074c4b287941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:46.279358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fc9bf-f2b6-4d76-a346-074c4b287941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:46.280801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fc9bf-f2b6-4d76-a346-074c4b287941 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:46.289940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1234/2472] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:28:46.457297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517df4c-02d9-463a-b91d-e1ea74ca1557 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:46.519023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517df4c-02d9-463a-b91d-e1ea74ca1557 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:46.523471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:46.524099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:46.524412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:46.524690 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] PATH_INFO: `/v3/users/459645a6a07640358f45c02b70ee7c05` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:46.525799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=459645a6a07640358f45c02b70ee7c05)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:46.527714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:46.537877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:46.688041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459645a6a07640358f45c02b70ee7c05'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:46.694964 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459645a6a07640358f45c02b70ee7c05'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:46.695644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459645a6a07640358f45c02b70ee7c05'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:46.756079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459645a6a07640358f45c02b70ee7c05'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:46.768420 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459645a6a07640358f45c02b70ee7c05'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:46.774309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1239/2473] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:28:46 2022] DELETE /identity/v3/users/459645a6a07640358f45c02b70ee7c05 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:46.778750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73748762-e790-4ca8-83dc-2564598908ae None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:46.779218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73748762-e790-4ca8-83dc-2564598908ae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:46.779330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73748762-e790-4ca8-83dc-2564598908ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:46.798405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-73748762-e790-4ca8-83dc-2564598908ae None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:46.799592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-73748762-e790-4ca8-83dc-2564598908ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:46.857082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1235/2474] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:46.866784 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:46.868555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:46.926406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdb87d-cfb8-493d-bbb0-1e77a20a5612 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:46.930115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63b776-63df-4892-80c1-c9d2aff7f716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:46.930715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63b776-63df-4892-80c1-c9d2aff7f716 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:46.930997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63b776-63df-4892-80c1-c9d2aff7f716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:46.931272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63b776-63df-4892-80c1-c9d2aff7f716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:46.940808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63b776-63df-4892-80c1-c9d2aff7f716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:46.942213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63b776-63df-4892-80c1-c9d2aff7f716 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:46.951448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1240/2475] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:28:47.328637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73748762-e790-4ca8-83dc-2564598908ae None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:47.330156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-73748762-e790-4ca8-83dc-2564598908ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:47.342595 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73748762-e790-4ca8-83dc-2564598908ae None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:47.353053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:47.354311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:47.354538 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:47.354819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] PATH_INFO: `/v3/projects/07b5ad0fb5394bad8adf545e19ed83c3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:47.355986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b5ad0fb5394bad8adf545e19ed83c3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:47.357920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:47.359652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:47.476051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b5ad0fb5394bad8adf545e19ed83c3', 'request_id': 'req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:47.482144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b5ad0fb5394bad8adf545e19ed83c3', 'request_id': 'req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:47.487627 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b5ad0fb5394bad8adf545e19ed83c3', 'request_id': 'req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:47.546389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] The token cache is being invalidate because project 07b5ad0fb5394bad8adf545e19ed83c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:28:47.546679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:47.547321 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:47.548855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1236/2476] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:28:47 2022] DELETE /identity/v3/projects/07b5ad0fb5394bad8adf545e19ed83c3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:47.552839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63b776-63df-4892-80c1-c9d2aff7f716 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:47.562646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63b776-63df-4892-80c1-c9d2aff7f716 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:47.618689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:47.619343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:47.619618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:47.619887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] PATH_INFO: `/v3/users/3883b052faaa449989d6d80e5e9050d7` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:47.621122 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3883b052faaa449989d6d80e5e9050d7)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:47.623094 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:47.768792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:47.781069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3883b052faaa449989d6d80e5e9050d7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:47.787841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3883b052faaa449989d6d80e5e9050d7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:47.788545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3883b052faaa449989d6d80e5e9050d7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:47.858917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3883b052faaa449989d6d80e5e9050d7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:47.871608 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9a40cbdd-e9f0-4a5f-9f85-e4d3485a5e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3883b052faaa449989d6d80e5e9050d7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:47.878374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1241/2477] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:28:47 2022] DELETE /identity/v3/users/3883b052faaa449989d6d80e5e9050d7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:48.240142 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:48.241767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:48.255667 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8d72-2aa7-4bb5-89ce-9b152b9dcda0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:48.313369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:48.314031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:48.314310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:48.314584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] PATH_INFO: `/v3/projects/05f5fb08bad94c86a2a47015445cb759` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:48.315698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f5fb08bad94c86a2a47015445cb759)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:48.317649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:48.418682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f5fb08bad94c86a2a47015445cb759', 'request_id': 'req-0cd2be70-f4b8-49b9-96e6-591c60271276'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:48.424643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f5fb08bad94c86a2a47015445cb759', 'request_id': 'req-0cd2be70-f4b8-49b9-96e6-591c60271276'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:48.430155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f5fb08bad94c86a2a47015445cb759', 'request_id': 'req-0cd2be70-f4b8-49b9-96e6-591c60271276'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:48.492050 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] The token cache is being invalidate because project 05f5fb08bad94c86a2a47015445cb759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:28:48.492372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:48.493265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0cd2be70-f4b8-49b9-96e6-591c60271276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:48.495331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1237/2478] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:28:48 2022] DELETE /identity/v3/projects/05f5fb08bad94c86a2a47015445cb759 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:48.500314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1695d4a-a127-4183-91f4-39dffdcd803c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:48.500630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1695d4a-a127-4183-91f4-39dffdcd803c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:48.500929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1695d4a-a127-4183-91f4-39dffdcd803c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:48.521115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a1695d4a-a127-4183-91f4-39dffdcd803c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:48.522320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a1695d4a-a127-4183-91f4-39dffdcd803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:48.580323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1242/2479] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:48.588108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc15983-03b1-4e40-be80-d4bd6dea304c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:48.588455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc15983-03b1-4e40-be80-d4bd6dea304c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:48.588734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc15983-03b1-4e40-be80-d4bd6dea304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:48.608001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bbc15983-03b1-4e40-be80-d4bd6dea304c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:48.609245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bbc15983-03b1-4e40-be80-d4bd6dea304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:48.617116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1238/2480] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:48.622147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1695d4a-a127-4183-91f4-39dffdcd803c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:48.631622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1695d4a-a127-4183-91f4-39dffdcd803c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:48.636677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30991359-f0d0-42a3-8966-b534bcb9638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:48.637266 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30991359-f0d0-42a3-8966-b534bcb9638d admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:48.637543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30991359-f0d0-42a3-8966-b534bcb9638d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:48.637814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30991359-f0d0-42a3-8966-b534bcb9638d admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:48.638446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30991359-f0d0-42a3-8966-b534bcb9638d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:28:48.638744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30991359-f0d0-42a3-8966-b534bcb9638d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:48.640344 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30991359-f0d0-42a3-8966-b534bcb9638d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:48.652133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1243/2481] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:28:48.656278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc15983-03b1-4e40-be80-d4bd6dea304c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:48.665527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc15983-03b1-4e40-be80-d4bd6dea304c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:48.670251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba730a1-1b6e-4b8a-9c39-0eb7a9135cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:48.670786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba730a1-1b6e-4b8a-9c39-0eb7a9135cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:48.671066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba730a1-1b6e-4b8a-9c39-0eb7a9135cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:48.671343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba730a1-1b6e-4b8a-9c39-0eb7a9135cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:48.671980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba730a1-1b6e-4b8a-9c39-0eb7a9135cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:48.673931 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba730a1-1b6e-4b8a-9c39-0eb7a9135cd9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:48.685549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:48.780179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1239/2482] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:28:48 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:28:48.784451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30991359-f0d0-42a3-8966-b534bcb9638d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:48.794513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30991359-f0d0-42a3-8966-b534bcb9638d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:48.850041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddb29a-082f-4b92-abff-e3b30ad0c51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:48.850637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddb29a-082f-4b92-abff-e3b30ad0c51f admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:48.850915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddb29a-082f-4b92-abff-e3b30ad0c51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:48.851184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddb29a-082f-4b92-abff-e3b30ad0c51f admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:48.851835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddb29a-082f-4b92-abff-e3b30ad0c51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:48.854242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddb29a-082f-4b92-abff-e3b30ad0c51f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:48.967834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1244/2483] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:28:48 2022] POST /identity/v3/users => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:28:48.974614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba730a1-1b6e-4b8a-9c39-0eb7a9135cd9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:48.985081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba730a1-1b6e-4b8a-9c39-0eb7a9135cd9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:48.989566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4608abc-0c04-4dec-99d1-602afc01234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:48.990151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608abc-0c04-4dec-99d1-602afc01234d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:48.990427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608abc-0c04-4dec-99d1-602afc01234d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:48.990695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608abc-0c04-4dec-99d1-602afc01234d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:48.991332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4608abc-0c04-4dec-99d1-602afc01234d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:48.993198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4608abc-0c04-4dec-99d1-602afc01234d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:49.003488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1240/2484] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:49.007176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddb29a-082f-4b92-abff-e3b30ad0c51f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:49.016883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddb29a-082f-4b92-abff-e3b30ad0c51f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:49.021469 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e74be-b426-4b74-9377-6269c7fc1b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:49.022065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e74be-b426-4b74-9377-6269c7fc1b40 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:49.022329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e74be-b426-4b74-9377-6269c7fc1b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:49.022602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e74be-b426-4b74-9377-6269c7fc1b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:49.023239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e74be-b426-4b74-9377-6269c7fc1b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:49.024850 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e74be-b426-4b74-9377-6269c7fc1b40 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:49.035205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1245/2485] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:49.038939 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4608abc-0c04-4dec-99d1-602afc01234d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:49.049005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4608abc-0c04-4dec-99d1-602afc01234d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:49.053491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6aa94a-7b1c-4bce-9d43-827af541140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:49.054119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aa94a-7b1c-4bce-9d43-827af541140c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:49.054395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aa94a-7b1c-4bce-9d43-827af541140c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:49.054668 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aa94a-7b1c-4bce-9d43-827af541140c admin admin] PATH_INFO: `/v3/projects/97586add44d4462c973110f9d1ea39d0/users/5445db5b9cb447a9954ec1f4fb77f14c/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:49.069312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6aa94a-7b1c-4bce-9d43-827af541140c admin admin] RBAC: Authorizing `identity:create_grant(project_id=97586add44d4462c973110f9d1ea39d0, user_id=5445db5b9cb447a9954ec1f4fb77f14c, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:49.071977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6aa94a-7b1c-4bce-9d43-827af541140c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:49.164421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1241/2486] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:28:49 2022] PUT /identity/v3/projects/97586add44d4462c973110f9d1ea39d0/users/5445db5b9cb447a9954ec1f4fb77f14c/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:49.169942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241e6d7-221c-4a51-bc35-947709659500 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:49.170229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241e6d7-221c-4a51-bc35-947709659500 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:49.170504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241e6d7-221c-4a51-bc35-947709659500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:49.189690 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a241e6d7-221c-4a51-bc35-947709659500 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:49.190884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a241e6d7-221c-4a51-bc35-947709659500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:49.200436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:49.249831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1246/2487] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:49.259251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6aa94a-7b1c-4bce-9d43-827af541140c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:49.261340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fe6aa94a-7b1c-4bce-9d43-827af541140c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:49.320167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6aa94a-7b1c-4bce-9d43-827af541140c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:49.325053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae715-fe5b-474e-915f-0645b09289ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:49.325661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae715-fe5b-474e-915f-0645b09289ae service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:49.325944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae715-fe5b-474e-915f-0645b09289ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:49.326218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae715-fe5b-474e-915f-0645b09289ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:49.335249 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae715-fe5b-474e-915f-0645b09289ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:49.336706 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae715-fe5b-474e-915f-0645b09289ae service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:49.346041 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1242/2488] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:28:50.512707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5148c67-6c83-4155-93b5-3892c7c7ba6c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:50.513293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5148c67-6c83-4155-93b5-3892c7c7ba6c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:50.513293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5148c67-6c83-4155-93b5-3892c7c7ba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:50.541254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a5148c67-6c83-4155-93b5-3892c7c7ba6c None None] MFA Rules not processed for user `5445db5b9cb447a9954ec1f4fb77f14c`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:50.542461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a5148c67-6c83-4155-93b5-3892c7c7ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:50.608528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1247/2489] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:50.613139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae715-fe5b-474e-915f-0645b09289ae service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:50.623509 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae715-fe5b-474e-915f-0645b09289ae service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:50.628459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85eaa6-54bc-4f80-bcb1-270e69e50ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:50.629151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85eaa6-54bc-4f80-bcb1-270e69e50ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:50.629435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85eaa6-54bc-4f80-bcb1-270e69e50ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:50.629711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85eaa6-54bc-4f80-bcb1-270e69e50ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:50.630357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85eaa6-54bc-4f80-bcb1-270e69e50ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:50.632307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85eaa6-54bc-4f80-bcb1-270e69e50ac0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:50.717994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1243/2490] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:28:50 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:28:50.722066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5148c67-6c83-4155-93b5-3892c7c7ba6c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:50.732712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5148c67-6c83-4155-93b5-3892c7c7ba6c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:50.788453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c8d62-6632-4c83-a2e0-c5893d4823af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:50.789072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c8d62-6632-4c83-a2e0-c5893d4823af admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:50.789351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c8d62-6632-4c83-a2e0-c5893d4823af admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:50.789624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c8d62-6632-4c83-a2e0-c5893d4823af admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:50.790255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c8d62-6632-4c83-a2e0-c5893d4823af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:50.792197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c8d62-6632-4c83-a2e0-c5893d4823af admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:50.861593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1248/2491] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:28:50 2022] POST /identity/v3/users => generated 309 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:28:50.865853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85eaa6-54bc-4f80-bcb1-270e69e50ac0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:50.876835 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85eaa6-54bc-4f80-bcb1-270e69e50ac0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:50.881378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae782ef4-bb85-4ed2-800b-9c94f0e88e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:50.881964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae782ef4-bb85-4ed2-800b-9c94f0e88e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:50.882241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae782ef4-bb85-4ed2-800b-9c94f0e88e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:50.882510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae782ef4-bb85-4ed2-800b-9c94f0e88e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:50.883143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae782ef4-bb85-4ed2-800b-9c94f0e88e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:50.885320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae782ef4-bb85-4ed2-800b-9c94f0e88e58 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:50.895547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1244/2492] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:28:50.910126 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c8d62-6632-4c83-a2e0-c5893d4823af admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:50.919886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c8d62-6632-4c83-a2e0-c5893d4823af admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:50.924443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930cd59-4fd9-4520-b3e4-9958614b243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:50.925219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930cd59-4fd9-4520-b3e4-9958614b243b admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:50.925328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930cd59-4fd9-4520-b3e4-9958614b243b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:50.925603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930cd59-4fd9-4520-b3e4-9958614b243b admin admin] PATH_INFO: `/v3/projects/068a88c7834c46b29aeec97c1909d5e0/users/54311dfb59e74551856cff89e13d9914/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:50.941537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930cd59-4fd9-4520-b3e4-9958614b243b admin admin] RBAC: Authorizing `identity:create_grant(project_id=068a88c7834c46b29aeec97c1909d5e0, user_id=54311dfb59e74551856cff89e13d9914, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:50.944089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930cd59-4fd9-4520-b3e4-9958614b243b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:51.013387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1249/2493] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:28:50 2022] PUT /identity/v3/projects/068a88c7834c46b29aeec97c1909d5e0/users/54311dfb59e74551856cff89e13d9914/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:51.017273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae782ef4-bb85-4ed2-800b-9c94f0e88e58 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:51.027143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae782ef4-bb85-4ed2-800b-9c94f0e88e58 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:51.081916 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abd5cf-4a29-479d-a470-a4774eb7561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:51.082508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abd5cf-4a29-479d-a470-a4774eb7561b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:51.082786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abd5cf-4a29-479d-a470-a4774eb7561b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:51.083056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abd5cf-4a29-479d-a470-a4774eb7561b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:51.083684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abd5cf-4a29-479d-a470-a4774eb7561b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:51.085282 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abd5cf-4a29-479d-a470-a4774eb7561b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:51.095202 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1245/2494] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:51.099350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930cd59-4fd9-4520-b3e4-9958614b243b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:51.109886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930cd59-4fd9-4520-b3e4-9958614b243b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:51.114447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06692bc2-9b99-439b-ada6-ff723f92cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:51.115082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06692bc2-9b99-439b-ada6-ff723f92cf3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:51.115357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06692bc2-9b99-439b-ada6-ff723f92cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:51.115628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06692bc2-9b99-439b-ada6-ff723f92cf3a admin admin] PATH_INFO: `/v3/projects/068a88c7834c46b29aeec97c1909d5e0/users/54311dfb59e74551856cff89e13d9914/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:51.117560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06692bc2-9b99-439b-ada6-ff723f92cf3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=068a88c7834c46b29aeec97c1909d5e0, user_id=54311dfb59e74551856cff89e13d9914, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:51.120426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06692bc2-9b99-439b-ada6-ff723f92cf3a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:51.125817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:51.131073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1250/2495] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:28:51 2022] PUT /identity/v3/projects/068a88c7834c46b29aeec97c1909d5e0/users/54311dfb59e74551856cff89e13d9914/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:28:52.414707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d69817-22e4-43c6-be19-6853051d1c71 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:52.415258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d69817-22e4-43c6-be19-6853051d1c71 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:52.415258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d69817-22e4-43c6-be19-6853051d1c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:52.448398 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-98d69817-22e4-43c6-be19-6853051d1c71 None None] MFA Rules not processed for user `54311dfb59e74551856cff89e13d9914`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:52.449669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-98d69817-22e4-43c6-be19-6853051d1c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:52.464292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:52.537485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1246/2496] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:53.851011 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06692bc2-9b99-439b-ada6-ff723f92cf3a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:53.916646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06692bc2-9b99-439b-ada6-ff723f92cf3a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:53.921369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:53.921993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:53.922274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:53.922548 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] PATH_INFO: `/v3/users/5445db5b9cb447a9954ec1f4fb77f14c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:53.923718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5445db5b9cb447a9954ec1f4fb77f14c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:53.925807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:54.138497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5445db5b9cb447a9954ec1f4fb77f14c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:54.145240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5445db5b9cb447a9954ec1f4fb77f14c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:54.145898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5445db5b9cb447a9954ec1f4fb77f14c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:54.238876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5445db5b9cb447a9954ec1f4fb77f14c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:54.251680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5445db5b9cb447a9954ec1f4fb77f14c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:54.257617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1251/2497] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:28:53 2022] DELETE /identity/v3/users/5445db5b9cb447a9954ec1f4fb77f14c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:54.507305 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d69817-22e4-43c6-be19-6853051d1c71 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:54.521334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d69817-22e4-43c6-be19-6853051d1c71 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:54.581250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:54.581887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:54.582165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:54.582440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] PATH_INFO: `/v3/projects/97586add44d4462c973110f9d1ea39d0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:54.583555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=97586add44d4462c973110f9d1ea39d0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:54.585485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:54.717378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97586add44d4462c973110f9d1ea39d0', 'request_id': 'req-a7795063-9a46-4330-9e36-c00d1a038e3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:54.724260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97586add44d4462c973110f9d1ea39d0', 'request_id': 'req-a7795063-9a46-4330-9e36-c00d1a038e3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:54.731867 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97586add44d4462c973110f9d1ea39d0', 'request_id': 'req-a7795063-9a46-4330-9e36-c00d1a038e3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:54.819308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] The token cache is being invalidate because project 97586add44d4462c973110f9d1ea39d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:28:54.819526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:54.820108 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:54.821769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1247/2498] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:28:54 2022] DELETE /identity/v3/projects/97586add44d4462c973110f9d1ea39d0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:28:54.826497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:54.827930 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:54.841345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb53300-e2c8-42df-929a-8cb62f0bf90e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:54.897754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:54.898420 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:54.898650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:54.898922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] PATH_INFO: `/v3/users/54311dfb59e74551856cff89e13d9914` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:54.900042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54311dfb59e74551856cff89e13d9914)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:54.901978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:54.922320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:55.107488 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54311dfb59e74551856cff89e13d9914'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:55.114118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54311dfb59e74551856cff89e13d9914'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:55.114778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54311dfb59e74551856cff89e13d9914'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:55.190262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54311dfb59e74551856cff89e13d9914'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:55.202806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b4a37fdf-c629-48fa-ac5f-15579abbe777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54311dfb59e74551856cff89e13d9914'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:55.208766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1252/2499] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:28:54 2022] DELETE /identity/v3/users/54311dfb59e74551856cff89e13d9914 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:55.486310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:55.487743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:55.501870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7795063-9a46-4330-9e36-c00d1a038e3b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:55.536704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:55.559767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:55.560520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:55.560795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:55.561066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] PATH_INFO: `/v3/projects/068a88c7834c46b29aeec97c1909d5e0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:55.562188 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068a88c7834c46b29aeec97c1909d5e0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:55.564333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:55.687262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068a88c7834c46b29aeec97c1909d5e0', 'request_id': 'req-bcdabade-b9d7-4e22-813d-926948a13687'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:55.693901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068a88c7834c46b29aeec97c1909d5e0', 'request_id': 'req-bcdabade-b9d7-4e22-813d-926948a13687'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:55.700522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068a88c7834c46b29aeec97c1909d5e0', 'request_id': 'req-bcdabade-b9d7-4e22-813d-926948a13687'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:55.769784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] The token cache is being invalidate because project 068a88c7834c46b29aeec97c1909d5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:28:55.770007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:55.770629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bcdabade-b9d7-4e22-813d-926948a13687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:55.772175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1248/2500] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:28:55 2022] DELETE /identity/v3/projects/068a88c7834c46b29aeec97c1909d5e0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:55.777638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd31884-c5da-4259-a071-562af8fc5901 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:55.777929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd31884-c5da-4259-a071-562af8fc5901 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:55.778435 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd31884-c5da-4259-a071-562af8fc5901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:55.798399 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7fd31884-c5da-4259-a071-562af8fc5901 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:55.799747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7fd31884-c5da-4259-a071-562af8fc5901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:55.860828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1253/2501] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:28:55.868623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7e49-6ef5-42f2-be3c-526b5df712ce None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:55.868908 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7e49-6ef5-42f2-be3c-526b5df712ce None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:55.869187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7e49-6ef5-42f2-be3c-526b5df712ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:55.889792 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b44e7e49-6ef5-42f2-be3c-526b5df712ce None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:55.890997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b44e7e49-6ef5-42f2-be3c-526b5df712ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:55.899253 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1249/2502] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:55.904030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd31884-c5da-4259-a071-562af8fc5901 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:55.914042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd31884-c5da-4259-a071-562af8fc5901 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:55.918791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556a4ee-b17e-4f23-a99b-faa492bdb96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:55.925143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556a4ee-b17e-4f23-a99b-faa492bdb96c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:55.925143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556a4ee-b17e-4f23-a99b-faa492bdb96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:55.925143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556a4ee-b17e-4f23-a99b-faa492bdb96c admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:55.925143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556a4ee-b17e-4f23-a99b-faa492bdb96c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:28:55.925143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556a4ee-b17e-4f23-a99b-faa492bdb96c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:55.925143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556a4ee-b17e-4f23-a99b-faa492bdb96c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:55.933958 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1254/2503] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:28:55.938048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7e49-6ef5-42f2-be3c-526b5df712ce None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:55.947432 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7e49-6ef5-42f2-be3c-526b5df712ce None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:55.952960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb764c-e817-436a-be8b-75978c2c4ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:55.953583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb764c-e817-436a-be8b-75978c2c4ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:55.953859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb764c-e817-436a-be8b-75978c2c4ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:55.954135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb764c-e817-436a-be8b-75978c2c4ee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:55.954775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb764c-e817-436a-be8b-75978c2c4ee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:55.956712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb764c-e817-436a-be8b-75978c2c4ee9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:56.037080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1250/2504] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:28:55 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:28:56.041073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556a4ee-b17e-4f23-a99b-faa492bdb96c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:56.050780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556a4ee-b17e-4f23-a99b-faa492bdb96c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:56.106101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d437c9-051e-4690-9ac9-30fee743bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:56.106693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d437c9-051e-4690-9ac9-30fee743bf7b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:56.106971 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d437c9-051e-4690-9ac9-30fee743bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:56.107244 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d437c9-051e-4690-9ac9-30fee743bf7b admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:56.107869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d437c9-051e-4690-9ac9-30fee743bf7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:56.109783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d437c9-051e-4690-9ac9-30fee743bf7b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:56.214146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1255/2505] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:28:56 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:28:56.218155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb764c-e817-436a-be8b-75978c2c4ee9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:56.228634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb764c-e817-436a-be8b-75978c2c4ee9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:56.233412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ac4a9-8d42-47e7-bd0f-bfa1725f8848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:56.234034 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ac4a9-8d42-47e7-bd0f-bfa1725f8848 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:56.234309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ac4a9-8d42-47e7-bd0f-bfa1725f8848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:56.234587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ac4a9-8d42-47e7-bd0f-bfa1725f8848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:56.235416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ac4a9-8d42-47e7-bd0f-bfa1725f8848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:56.237029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ac4a9-8d42-47e7-bd0f-bfa1725f8848 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:56.247807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1251/2506] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:56.251718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d437c9-051e-4690-9ac9-30fee743bf7b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:56.262239 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d437c9-051e-4690-9ac9-30fee743bf7b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:56.266909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9953110-50fa-489d-a8ee-5e34fecb94d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:56.267501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9953110-50fa-489d-a8ee-5e34fecb94d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:56.267780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9953110-50fa-489d-a8ee-5e34fecb94d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:56.268058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9953110-50fa-489d-a8ee-5e34fecb94d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:56.268744 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9953110-50fa-489d-a8ee-5e34fecb94d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:56.270314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9953110-50fa-489d-a8ee-5e34fecb94d5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:56.280747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1256/2507] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:56.284952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ac4a9-8d42-47e7-bd0f-bfa1725f8848 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:56.295174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ac4a9-8d42-47e7-bd0f-bfa1725f8848 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:56.299800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9c152-9b65-49c5-9517-381a1993015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:56.300602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9c152-9b65-49c5-9517-381a1993015a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:56.300883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9c152-9b65-49c5-9517-381a1993015a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:56.303763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9c152-9b65-49c5-9517-381a1993015a admin admin] PATH_INFO: `/v3/projects/e74c916338a84c6d8cc72b0dd1c65c5a/users/4c2d7a98e28e46fca9790561aada60d5/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:56.316295 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9c152-9b65-49c5-9517-381a1993015a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74c916338a84c6d8cc72b0dd1c65c5a, user_id=4c2d7a98e28e46fca9790561aada60d5, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:56.318981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9c152-9b65-49c5-9517-381a1993015a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:56.404891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1252/2508] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:28:56 2022] PUT /identity/v3/projects/e74c916338a84c6d8cc72b0dd1c65c5a/users/4c2d7a98e28e46fca9790561aada60d5/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:56.416197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ee423-8f49-4cde-aba4-1bf91352928a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:56.417056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ee423-8f49-4cde-aba4-1bf91352928a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:56.417356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ee423-8f49-4cde-aba4-1bf91352928a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:56.424524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:56.445842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e68ee423-8f49-4cde-aba4-1bf91352928a None None] MFA Rules not processed for user `4c2d7a98e28e46fca9790561aada60d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:56.447051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e68ee423-8f49-4cde-aba4-1bf91352928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:56.510531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1257/2509] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:56.515229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9c152-9b65-49c5-9517-381a1993015a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:56.577680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9c152-9b65-49c5-9517-381a1993015a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:56.582686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6ac0-6bd0-4886-a6b7-f98767341ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:56.585816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6ac0-6bd0-4886-a6b7-f98767341ceb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:56.585816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6ac0-6bd0-4886-a6b7-f98767341ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:56.585816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6ac0-6bd0-4886-a6b7-f98767341ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:56.585816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6ac0-6bd0-4886-a6b7-f98767341ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:56.586535 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6ac0-6bd0-4886-a6b7-f98767341ceb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:56.596599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:56.707796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1253/2510] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:28:56 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:28:56.711906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ee423-8f49-4cde-aba4-1bf91352928a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:56.725572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ee423-8f49-4cde-aba4-1bf91352928a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:56.786839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab831b-e51f-4db6-a35a-824707aaa67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:56.787459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab831b-e51f-4db6-a35a-824707aaa67f admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:56.787764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab831b-e51f-4db6-a35a-824707aaa67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:56.788069 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab831b-e51f-4db6-a35a-824707aaa67f admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:56.788781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab831b-e51f-4db6-a35a-824707aaa67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:56.790692 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab831b-e51f-4db6-a35a-824707aaa67f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:56.865060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1258/2511] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:28:56 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:28:56.870467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6ac0-6bd0-4886-a6b7-f98767341ceb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:56.880345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6ac0-6bd0-4886-a6b7-f98767341ceb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:56.885142 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6291540-093a-45b6-9f6a-fc38068a8f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:56.886097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6291540-093a-45b6-9f6a-fc38068a8f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:56.886254 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6291540-093a-45b6-9f6a-fc38068a8f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:56.886536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6291540-093a-45b6-9f6a-fc38068a8f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:56.887190 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6291540-093a-45b6-9f6a-fc38068a8f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:56.888850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6291540-093a-45b6-9f6a-fc38068a8f6d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:56.903685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1254/2512] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:56.905182 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab831b-e51f-4db6-a35a-824707aaa67f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:56.915585 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab831b-e51f-4db6-a35a-824707aaa67f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:56.920858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa881-873a-42f5-abe8-aaf238569827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:56.921789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa881-873a-42f5-abe8-aaf238569827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:56.921980 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa881-873a-42f5-abe8-aaf238569827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:56.922260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa881-873a-42f5-abe8-aaf238569827 admin admin] PATH_INFO: `/v3/projects/00af68c15007443c95f700d20102a3f7/users/41e27bf1928e4be580db9a8ae1d7f736/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:56.937426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caa881-873a-42f5-abe8-aaf238569827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00af68c15007443c95f700d20102a3f7, user_id=41e27bf1928e4be580db9a8ae1d7f736, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:56.940235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caa881-873a-42f5-abe8-aaf238569827 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:57.033592 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1259/2513] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:28:56 2022] PUT /identity/v3/projects/00af68c15007443c95f700d20102a3f7/users/41e27bf1928e4be580db9a8ae1d7f736/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:57.037504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6291540-093a-45b6-9f6a-fc38068a8f6d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:57.048320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6291540-093a-45b6-9f6a-fc38068a8f6d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:57.105051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afe472-c9cd-494e-b6fc-b301a29e333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:57.105685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afe472-c9cd-494e-b6fc-b301a29e333b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:57.105969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afe472-c9cd-494e-b6fc-b301a29e333b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:57.106246 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afe472-c9cd-494e-b6fc-b301a29e333b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:57.106891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afe472-c9cd-494e-b6fc-b301a29e333b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:57.108511 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afe472-c9cd-494e-b6fc-b301a29e333b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:57.118402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1255/2514] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:28:57.122621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa881-873a-42f5-abe8-aaf238569827 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:57.132710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa881-873a-42f5-abe8-aaf238569827 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:57.138103 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252ac47-5285-472e-b7b9-07181d24484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:57.138777 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252ac47-5285-472e-b7b9-07181d24484b admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:57.139056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252ac47-5285-472e-b7b9-07181d24484b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:57.139328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252ac47-5285-472e-b7b9-07181d24484b admin admin] PATH_INFO: `/v3/projects/00af68c15007443c95f700d20102a3f7/users/41e27bf1928e4be580db9a8ae1d7f736/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:57.141340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252ac47-5285-472e-b7b9-07181d24484b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00af68c15007443c95f700d20102a3f7, user_id=41e27bf1928e4be580db9a8ae1d7f736, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:57.144076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252ac47-5285-472e-b7b9-07181d24484b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:57.157510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1260/2515] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:28:57 2022] PUT /identity/v3/projects/00af68c15007443c95f700d20102a3f7/users/41e27bf1928e4be580db9a8ae1d7f736/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:28:57.168010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3db43d-e7fe-4cb4-b5d4-f150e02e20d4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:57.168424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3db43d-e7fe-4cb4-b5d4-f150e02e20d4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:57.168810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3db43d-e7fe-4cb4-b5d4-f150e02e20d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:57.198133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2d3db43d-e7fe-4cb4-b5d4-f150e02e20d4 None None] MFA Rules not processed for user `41e27bf1928e4be580db9a8ae1d7f736`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:57.199357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2d3db43d-e7fe-4cb4-b5d4-f150e02e20d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:57.267596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1256/2516] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:57.279908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252ac47-5285-472e-b7b9-07181d24484b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:57.281736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e252ac47-5285-472e-b7b9-07181d24484b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:57.331005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:57.342113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252ac47-5285-472e-b7b9-07181d24484b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:57.345835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a6299-7f11-4333-90ca-332dc132a252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:57.346440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6299-7f11-4333-90ca-332dc132a252 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:57.346722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6299-7f11-4333-90ca-332dc132a252 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:57.346998 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6299-7f11-4333-90ca-332dc132a252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:57.356041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a6299-7f11-4333-90ca-332dc132a252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:57.357434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a6299-7f11-4333-90ca-332dc132a252 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:57.366667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1261/2517] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:28:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:28:57.431625 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3db43d-e7fe-4cb4-b5d4-f150e02e20d4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:57.493203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3db43d-e7fe-4cb4-b5d4-f150e02e20d4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:57.498271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:57.498892 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:57.499172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:57.499447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] PATH_INFO: `/v3/users/4c2d7a98e28e46fca9790561aada60d5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:57.500591 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2d7a98e28e46fca9790561aada60d5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:57.502484 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:57.503932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:57.711417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2d7a98e28e46fca9790561aada60d5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:57.720079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2d7a98e28e46fca9790561aada60d5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:57.793164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2d7a98e28e46fca9790561aada60d5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:57.793793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2d7a98e28e46fca9790561aada60d5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:57.794409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2d7a98e28e46fca9790561aada60d5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:57.812596 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1257/2518] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:28:57 2022] DELETE /identity/v3/users/4c2d7a98e28e46fca9790561aada60d5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:57.817133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf441ef-7bb3-42b8-8a96-6c4ca0bee615 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:57.817417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf441ef-7bb3-42b8-8a96-6c4ca0bee615 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:57.817688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf441ef-7bb3-42b8-8a96-6c4ca0bee615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:57.837079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7cf441ef-7bb3-42b8-8a96-6c4ca0bee615 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:57.838272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7cf441ef-7bb3-42b8-8a96-6c4ca0bee615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:57.897345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1262/2519] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:28:57.907079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:57.908559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:57.966817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f5777-012b-49d1-a827-106ff116d5bd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:57.970373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b67bf-3942-458f-94a4-82fdb70d2d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:57.970974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b67bf-3942-458f-94a4-82fdb70d2d31 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:57.971248 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b67bf-3942-458f-94a4-82fdb70d2d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:57.971518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b67bf-3942-458f-94a4-82fdb70d2d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:57.981275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b67bf-3942-458f-94a4-82fdb70d2d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:57.982748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b67bf-3942-458f-94a4-82fdb70d2d31 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:57.992475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1258/2520] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:28:58.489797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf441ef-7bb3-42b8-8a96-6c4ca0bee615 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:58.492199 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7cf441ef-7bb3-42b8-8a96-6c4ca0bee615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:58.507187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf441ef-7bb3-42b8-8a96-6c4ca0bee615 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:58.512986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:58.513637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:58.513918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:58.514196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] PATH_INFO: `/v3/projects/e74c916338a84c6d8cc72b0dd1c65c5a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:58.515305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74c916338a84c6d8cc72b0dd1c65c5a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:58.517487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:58.633468 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74c916338a84c6d8cc72b0dd1c65c5a', 'request_id': 'req-a4a15087-651b-4268-abc2-b9632cabe978'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:58.640106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74c916338a84c6d8cc72b0dd1c65c5a', 'request_id': 'req-a4a15087-651b-4268-abc2-b9632cabe978'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:58.695988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74c916338a84c6d8cc72b0dd1c65c5a', 'request_id': 'req-a4a15087-651b-4268-abc2-b9632cabe978'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:58.707555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] The token cache is being invalidate because project e74c916338a84c6d8cc72b0dd1c65c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:28:58.707845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:58.708492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:58.710029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1263/2521] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:28:58 2022] DELETE /identity/v3/projects/e74c916338a84c6d8cc72b0dd1c65c5a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:28:58.714586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b67bf-3942-458f-94a4-82fdb70d2d31 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:58.724078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b67bf-3942-458f-94a4-82fdb70d2d31 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:58.780320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:58.780915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:58.781197 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:58.781478 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] PATH_INFO: `/v3/users/41e27bf1928e4be580db9a8ae1d7f736` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:58.782606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e27bf1928e4be580db9a8ae1d7f736)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:58.784585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:58.807079 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:58.982955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e27bf1928e4be580db9a8ae1d7f736'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:58.989688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e27bf1928e4be580db9a8ae1d7f736'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:59.055348 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e27bf1928e4be580db9a8ae1d7f736'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:59.055907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e27bf1928e4be580db9a8ae1d7f736'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:59.056531 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0df204ef-50c7-40d7-983f-b1b2bc7b8b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e27bf1928e4be580db9a8ae1d7f736'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:59.074922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1259/2522] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:28:58 2022] DELETE /identity/v3/users/41e27bf1928e4be580db9a8ae1d7f736 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:59.511978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:59.513698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:59.529023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a15087-651b-4268-abc2-b9632cabe978 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:59.588357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:59.588923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:59.589206 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:59.589480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] PATH_INFO: `/v3/projects/00af68c15007443c95f700d20102a3f7` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:59.590597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=00af68c15007443c95f700d20102a3f7)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:59.592564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:59.604334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:28:59.734307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00af68c15007443c95f700d20102a3f7', 'request_id': 'req-3c78e491-94ea-4d93-aca7-ced05df71efd'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:59.740484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00af68c15007443c95f700d20102a3f7', 'request_id': 'req-3c78e491-94ea-4d93-aca7-ced05df71efd'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:59.807754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00af68c15007443c95f700d20102a3f7', 'request_id': 'req-3c78e491-94ea-4d93-aca7-ced05df71efd'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:59.819587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] The token cache is being invalidate because project 00af68c15007443c95f700d20102a3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:28:59.819993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:59.820678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3c78e491-94ea-4d93-aca7-ced05df71efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:28:59.822208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1264/2523] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:28:59 2022] DELETE /identity/v3/projects/00af68c15007443c95f700d20102a3f7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:28:59.827247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a09cf-67e0-4101-8418-66b03ed55459 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:59.827740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a09cf-67e0-4101-8418-66b03ed55459 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:59.827942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a09cf-67e0-4101-8418-66b03ed55459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:59.850086 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bf3a09cf-67e0-4101-8418-66b03ed55459 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:59.851322 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf3a09cf-67e0-4101-8418-66b03ed55459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:59.912061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1260/2524] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:28:59.920812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe26e5-75bf-422d-a7fa-af3d0721c8e2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:59.921092 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe26e5-75bf-422d-a7fa-af3d0721c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:59.921363 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe26e5-75bf-422d-a7fa-af3d0721c8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:59.940960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-90fe26e5-75bf-422d-a7fa-af3d0721c8e2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:28:59.942136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-90fe26e5-75bf-422d-a7fa-af3d0721c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:28:59.950089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1265/2525] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:28:59.954433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a09cf-67e0-4101-8418-66b03ed55459 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:28:59.964891 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a09cf-67e0-4101-8418-66b03ed55459 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:28:59.969552 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e524d5-461a-47de-a5fc-8f3be47ac8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:28:59.970142 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e524d5-461a-47de-a5fc-8f3be47ac8ec admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:28:59.970420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e524d5-461a-47de-a5fc-8f3be47ac8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:28:59.970694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e524d5-461a-47de-a5fc-8f3be47ac8ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:28:59.971336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e524d5-461a-47de-a5fc-8f3be47ac8ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:28:59.971641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e524d5-461a-47de-a5fc-8f3be47ac8ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:28:59.973251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e524d5-461a-47de-a5fc-8f3be47ac8ec admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:28:59.985606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1261/2526] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:28:59.995675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe26e5-75bf-422d-a7fa-af3d0721c8e2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:00.004805 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe26e5-75bf-422d-a7fa-af3d0721c8e2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:00.009360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f148d8-ec68-45f1-9f50-41ec05103c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:00.009973 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f148d8-ec68-45f1-9f50-41ec05103c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:00.010457 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f148d8-ec68-45f1-9f50-41ec05103c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:00.010723 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f148d8-ec68-45f1-9f50-41ec05103c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:00.011372 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f148d8-ec68-45f1-9f50-41ec05103c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:00.013329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f148d8-ec68-45f1-9f50-41ec05103c9f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:00.099792 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1266/2527] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:28:59 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:00.101455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e524d5-461a-47de-a5fc-8f3be47ac8ec admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:00.112321 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e524d5-461a-47de-a5fc-8f3be47ac8ec admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:00.169292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd012b6a-6c23-41d7-a65b-fd394672edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:00.169907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd012b6a-6c23-41d7-a65b-fd394672edd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:00.170208 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd012b6a-6c23-41d7-a65b-fd394672edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:00.170487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd012b6a-6c23-41d7-a65b-fd394672edd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:00.171114 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd012b6a-6c23-41d7-a65b-fd394672edd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:00.173058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd012b6a-6c23-41d7-a65b-fd394672edd5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:00.264414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1262/2528] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:00 2022] POST /identity/v3/users => generated 284 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:00.268694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f148d8-ec68-45f1-9f50-41ec05103c9f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:00.279453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f148d8-ec68-45f1-9f50-41ec05103c9f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:00.284088 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1377fd-8d6d-4071-bda5-8f1cc8758ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:00.284705 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1377fd-8d6d-4071-bda5-8f1cc8758ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:00.284985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1377fd-8d6d-4071-bda5-8f1cc8758ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:00.285257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1377fd-8d6d-4071-bda5-8f1cc8758ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:00.285898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1377fd-8d6d-4071-bda5-8f1cc8758ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:00.287559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1377fd-8d6d-4071-bda5-8f1cc8758ee6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:00.297277 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1267/2529] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:00.301068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd012b6a-6c23-41d7-a65b-fd394672edd5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:00.310713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd012b6a-6c23-41d7-a65b-fd394672edd5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:00.315275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95a22a-a7ca-4e71-9ab9-d2ac3f1e29b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:00.315850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95a22a-a7ca-4e71-9ab9-d2ac3f1e29b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:00.316127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95a22a-a7ca-4e71-9ab9-d2ac3f1e29b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:00.316428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95a22a-a7ca-4e71-9ab9-d2ac3f1e29b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:00.317061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95a22a-a7ca-4e71-9ab9-d2ac3f1e29b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:00.318624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95a22a-a7ca-4e71-9ab9-d2ac3f1e29b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:00.329278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1263/2530] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:00.333193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1377fd-8d6d-4071-bda5-8f1cc8758ee6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:00.343444 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1377fd-8d6d-4071-bda5-8f1cc8758ee6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:00.348027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dfb70-c573-4a4d-b087-100ae0b015e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:00.348699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dfb70-c573-4a4d-b087-100ae0b015e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:00.348982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dfb70-c573-4a4d-b087-100ae0b015e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:00.349257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dfb70-c573-4a4d-b087-100ae0b015e7 admin admin] PATH_INFO: `/v3/projects/bb7ea5f6eeb543248152dcafa5187230/users/b9e4a6b3a11f4e899d1250ab7a318c0e/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:00.363298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dfb70-c573-4a4d-b087-100ae0b015e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7ea5f6eeb543248152dcafa5187230, user_id=b9e4a6b3a11f4e899d1250ab7a318c0e, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:00.365911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dfb70-c573-4a4d-b087-100ae0b015e7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:00.441014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1268/2531] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:00 2022] PUT /identity/v3/projects/bb7ea5f6eeb543248152dcafa5187230/users/b9e4a6b3a11f4e899d1250ab7a318c0e/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:00.452624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f066a9-9b83-414c-a671-5c6e34595089 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:00.452909 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f066a9-9b83-414c-a671-5c6e34595089 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:00.453190 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f066a9-9b83-414c-a671-5c6e34595089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:00.467059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:00.481004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f2f066a9-9b83-414c-a671-5c6e34595089 None None] MFA Rules not processed for user `b9e4a6b3a11f4e899d1250ab7a318c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:00.482230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f2f066a9-9b83-414c-a671-5c6e34595089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:00.545224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1264/2532] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:00.549789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dfb70-c573-4a4d-b087-100ae0b015e7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:00.611908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dfb70-c573-4a4d-b087-100ae0b015e7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:00.616671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b106a-1450-4468-a342-a01fc6f27455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:00.617210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b106a-1450-4468-a342-a01fc6f27455 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:00.617492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b106a-1450-4468-a342-a01fc6f27455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:00.618020 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b106a-1450-4468-a342-a01fc6f27455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:00.618646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b106a-1450-4468-a342-a01fc6f27455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:00.621066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b106a-1450-4468-a342-a01fc6f27455 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:00.703487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1269/2533] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:00 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:00.707649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f066a9-9b83-414c-a671-5c6e34595089 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:00.718347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f066a9-9b83-414c-a671-5c6e34595089 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:00.777918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e1f71-9172-436a-8454-c20b96ee0fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:00.778529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1f71-9172-436a-8454-c20b96ee0fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:00.778808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1f71-9172-436a-8454-c20b96ee0fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:00.779081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1f71-9172-436a-8454-c20b96ee0fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:00.779719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e1f71-9172-436a-8454-c20b96ee0fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:00.781658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e1f71-9172-436a-8454-c20b96ee0fe4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:00.881521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1265/2534] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:00 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:00.891750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b106a-1450-4468-a342-a01fc6f27455 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:00.896927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b106a-1450-4468-a342-a01fc6f27455 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:00.902138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85630e47-4f6d-4050-98ed-645c17a0c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:00.902428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630e47-4f6d-4050-98ed-645c17a0c61a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:00.902710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630e47-4f6d-4050-98ed-645c17a0c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:00.903012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630e47-4f6d-4050-98ed-645c17a0c61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:00.903638 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85630e47-4f6d-4050-98ed-645c17a0c61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:00.905251 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85630e47-4f6d-4050-98ed-645c17a0c61a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:00.916158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1270/2535] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:00.921101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e1f71-9172-436a-8454-c20b96ee0fe4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:00.931081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e1f71-9172-436a-8454-c20b96ee0fe4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:00.936332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdd34b-9cad-4818-b2e9-866be3c08d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:00.936980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdd34b-9cad-4818-b2e9-866be3c08d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:00.937266 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdd34b-9cad-4818-b2e9-866be3c08d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:00.937575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdd34b-9cad-4818-b2e9-866be3c08d95 admin admin] PATH_INFO: `/v3/projects/2ddb7f8e21c04d7f94db8cf7aa357f8e/users/0c95a794b488471285bad247c3d2a94e/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:00.952810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdd34b-9cad-4818-b2e9-866be3c08d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ddb7f8e21c04d7f94db8cf7aa357f8e, user_id=0c95a794b488471285bad247c3d2a94e, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:00.955464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdd34b-9cad-4818-b2e9-866be3c08d95 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:01.050952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1266/2536] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:00 2022] PUT /identity/v3/projects/2ddb7f8e21c04d7f94db8cf7aa357f8e/users/0c95a794b488471285bad247c3d2a94e/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:01.054922 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85630e47-4f6d-4050-98ed-645c17a0c61a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:01.065680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85630e47-4f6d-4050-98ed-645c17a0c61a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:01.073697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:01.121543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26ab4a-8755-4d0c-b560-ec47c9d271a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:01.122143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ab4a-8755-4d0c-b560-ec47c9d271a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:01.122422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ab4a-8755-4d0c-b560-ec47c9d271a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:01.122693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26ab4a-8755-4d0c-b560-ec47c9d271a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:01.123434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26ab4a-8755-4d0c-b560-ec47c9d271a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:01.125408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26ab4a-8755-4d0c-b560-ec47c9d271a2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:01.138025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1271/2537] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:01.139768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdd34b-9cad-4818-b2e9-866be3c08d95 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:01.150239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdd34b-9cad-4818-b2e9-866be3c08d95 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:01.154859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9fe06-6510-4524-ad76-0fa1f696c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:01.155637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9fe06-6510-4524-ad76-0fa1f696c9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:01.155917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9fe06-6510-4524-ad76-0fa1f696c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:01.156189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9fe06-6510-4524-ad76-0fa1f696c9a4 admin admin] PATH_INFO: `/v3/projects/2ddb7f8e21c04d7f94db8cf7aa357f8e/users/0c95a794b488471285bad247c3d2a94e/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:01.158287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9fe06-6510-4524-ad76-0fa1f696c9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ddb7f8e21c04d7f94db8cf7aa357f8e, user_id=0c95a794b488471285bad247c3d2a94e, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:01.160925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9fe06-6510-4524-ad76-0fa1f696c9a4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:01.171645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1267/2538] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:01 2022] PUT /identity/v3/projects/2ddb7f8e21c04d7f94db8cf7aa357f8e/users/0c95a794b488471285bad247c3d2a94e/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:01.184919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cce45-009c-4a57-b2ce-1c252138f2ed None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:01.185208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cce45-009c-4a57-b2ce-1c252138f2ed None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:01.185514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cce45-009c-4a57-b2ce-1c252138f2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:01.213053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-489cce45-009c-4a57-b2ce-1c252138f2ed None None] MFA Rules not processed for user `0c95a794b488471285bad247c3d2a94e`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:01.214960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-489cce45-009c-4a57-b2ce-1c252138f2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:01.281348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1272/2539] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:01.293046 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9fe06-6510-4524-ad76-0fa1f696c9a4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:01.294722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5ba9fe06-6510-4524-ad76-0fa1f696c9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:01.347528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:01.351293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9fe06-6510-4524-ad76-0fa1f696c9a4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:01.355628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9f8ef-3495-4546-bffb-2a7c671b5f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:01.356252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9f8ef-3495-4546-bffb-2a7c671b5f09 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:01.356535 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9f8ef-3495-4546-bffb-2a7c671b5f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:01.356811 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9f8ef-3495-4546-bffb-2a7c671b5f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:01.366129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9f8ef-3495-4546-bffb-2a7c671b5f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:01.367933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9f8ef-3495-4546-bffb-2a7c671b5f09 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:01.378917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1268/2540] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:01.604450 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cce45-009c-4a57-b2ce-1c252138f2ed None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:01.614030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cce45-009c-4a57-b2ce-1c252138f2ed None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:01.617878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866266b3-1335-4a1c-b863-4b50e7f62439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:01.618468 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866266b3-1335-4a1c-b863-4b50e7f62439 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:01.618742 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866266b3-1335-4a1c-b863-4b50e7f62439 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:01.619009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866266b3-1335-4a1c-b863-4b50e7f62439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:01.676045 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866266b3-1335-4a1c-b863-4b50e7f62439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:01.677505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866266b3-1335-4a1c-b863-4b50e7f62439 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:01.686471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1273/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:08.336411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9f8ef-3495-4546-bffb-2a7c671b5f09 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:08.406476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9f8ef-3495-4546-bffb-2a7c671b5f09 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:08.411123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:08.413733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:08.413733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:08.413733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] PATH_INFO: `/v3/users/b9e4a6b3a11f4e899d1250ab7a318c0e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:08.416961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e4a6b3a11f4e899d1250ab7a318c0e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:08.418862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:08.611548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e4a6b3a11f4e899d1250ab7a318c0e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:08.619421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e4a6b3a11f4e899d1250ab7a318c0e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:08.681901 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e4a6b3a11f4e899d1250ab7a318c0e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:08.682579 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e4a6b3a11f4e899d1250ab7a318c0e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:08.683258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e4a6b3a11f4e899d1250ab7a318c0e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:08.702210 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1269/2542] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:08 2022] DELETE /identity/v3/users/b9e4a6b3a11f4e899d1250ab7a318c0e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:08.706655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e69b1-08b1-4e52-a684-5f16ac0a3bbc None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:08.707090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e69b1-08b1-4e52-a684-5f16ac0a3bbc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:08.707346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e69b1-08b1-4e52-a684-5f16ac0a3bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:08.726668 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3c5e69b1-08b1-4e52-a684-5f16ac0a3bbc None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:08.727876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3c5e69b1-08b1-4e52-a684-5f16ac0a3bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:08.754133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:08.788107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1274/2543] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:08.797780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:08.799229 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:08.858887 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6198f-94b4-4f33-a9fe-e804cc4fd748 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:08.862612 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbf5b0-b577-495f-9dc4-8c048bd1085d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:08.863237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbf5b0-b577-495f-9dc4-8c048bd1085d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:08.863501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbf5b0-b577-495f-9dc4-8c048bd1085d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:08.863775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbf5b0-b577-495f-9dc4-8c048bd1085d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:08.873629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbf5b0-b577-495f-9dc4-8c048bd1085d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:08.875081 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbf5b0-b577-495f-9dc4-8c048bd1085d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:08.884677 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1270/2544] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:09.315156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e69b1-08b1-4e52-a684-5f16ac0a3bbc None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:09.316614 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3c5e69b1-08b1-4e52-a684-5f16ac0a3bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:09.330162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e69b1-08b1-4e52-a684-5f16ac0a3bbc None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:09.334855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:09.335490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:09.335772 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:09.336595 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] PATH_INFO: `/v3/projects/bb7ea5f6eeb543248152dcafa5187230` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:09.337909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7ea5f6eeb543248152dcafa5187230)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:09.339811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:09.449708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7ea5f6eeb543248152dcafa5187230', 'request_id': 'req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:09.455948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7ea5f6eeb543248152dcafa5187230', 'request_id': 'req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:09.529710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7ea5f6eeb543248152dcafa5187230', 'request_id': 'req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:09.540316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] The token cache is being invalidate because project bb7ea5f6eeb543248152dcafa5187230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:09.540642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:09.541271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:09.542747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1275/2545] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:09 2022] DELETE /identity/v3/projects/bb7ea5f6eeb543248152dcafa5187230 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:09.547497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbf5b0-b577-495f-9dc4-8c048bd1085d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:09.557987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbf5b0-b577-495f-9dc4-8c048bd1085d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:09.566732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:09.616818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:09.617704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:09.618005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:09.618273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] PATH_INFO: `/v3/users/0c95a794b488471285bad247c3d2a94e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:09.619409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c95a794b488471285bad247c3d2a94e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:09.625897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:09.853016 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:09.854441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:09.912979 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6053da9-fbde-4bc5-9ad5-cffef0ba2c68 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:09.916694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2663ec-378c-4da6-9c68-9f0973527c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:09.917303 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2663ec-378c-4da6-9c68-9f0973527c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:09.917583 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2663ec-378c-4da6-9c68-9f0973527c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:09.917854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2663ec-378c-4da6-9c68-9f0973527c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:09.919632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2e2663ec-378c-4da6-9c68-9f0973527c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:09.932297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2663ec-378c-4da6-9c68-9f0973527c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:09.933722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2663ec-378c-4da6-9c68-9f0973527c78 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:09.939058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c95a794b488471285bad247c3d2a94e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:09.943475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1276/2546] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:09.946631 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c95a794b488471285bad247c3d2a94e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:10.047096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c95a794b488471285bad247c3d2a94e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:10.047763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c95a794b488471285bad247c3d2a94e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:10.048433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5a06e41f-1bab-40b0-b694-359bcbffc258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c95a794b488471285bad247c3d2a94e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:10.066320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1271/2547] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:09 2022] DELETE /identity/v3/users/0c95a794b488471285bad247c3d2a94e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:10.482986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2663ec-378c-4da6-9c68-9f0973527c78 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:10.484590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2e2663ec-378c-4da6-9c68-9f0973527c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:10.505056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2663ec-378c-4da6-9c68-9f0973527c78 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:10.563117 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:10.569117 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:10.569759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:10.570036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:10.570306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] PATH_INFO: `/v3/projects/2ddb7f8e21c04d7f94db8cf7aa357f8e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:10.571568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ddb7f8e21c04d7f94db8cf7aa357f8e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:10.573495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:10.747897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ddb7f8e21c04d7f94db8cf7aa357f8e', 'request_id': 'req-c1f36892-2ecc-45cc-8c3e-d0d886be1436'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:10.754482 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ddb7f8e21c04d7f94db8cf7aa357f8e', 'request_id': 'req-c1f36892-2ecc-45cc-8c3e-d0d886be1436'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:10.838563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ddb7f8e21c04d7f94db8cf7aa357f8e', 'request_id': 'req-c1f36892-2ecc-45cc-8c3e-d0d886be1436'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:10.850152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] The token cache is being invalidate because project 2ddb7f8e21c04d7f94db8cf7aa357f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:10.850443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:10.851079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c1f36892-2ecc-45cc-8c3e-d0d886be1436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:10.852700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1277/2548] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:10 2022] DELETE /identity/v3/projects/2ddb7f8e21c04d7f94db8cf7aa357f8e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:10.858182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d94b1c-d8b4-4e26-b9f4-81792481589b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:10.858644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d94b1c-d8b4-4e26-b9f4-81792481589b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:10.858928 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d94b1c-d8b4-4e26-b9f4-81792481589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:10.880235 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c0d94b1c-d8b4-4e26-b9f4-81792481589b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:10.881506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0d94b1c-d8b4-4e26-b9f4-81792481589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:10.943074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1272/2549] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:10.952120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d3cad-975a-4c9d-b273-66f879722af8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:10.952675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d3cad-975a-4c9d-b273-66f879722af8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:10.952839 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d3cad-975a-4c9d-b273-66f879722af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:10.974871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-577d3cad-975a-4c9d-b273-66f879722af8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:10.976188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-577d3cad-975a-4c9d-b273-66f879722af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:10.985212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1278/2550] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:10.989232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d94b1c-d8b4-4e26-b9f4-81792481589b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:11.005223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d94b1c-d8b4-4e26-b9f4-81792481589b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:11.005223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75338f-5663-4eea-9d81-c39590943b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:11.005594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75338f-5663-4eea-9d81-c39590943b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:11.005594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75338f-5663-4eea-9d81-c39590943b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:11.005843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75338f-5663-4eea-9d81-c39590943b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:11.006477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75338f-5663-4eea-9d81-c39590943b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:29:11.006778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75338f-5663-4eea-9d81-c39590943b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:11.008384 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75338f-5663-4eea-9d81-c39590943b38 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:11.022354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1273/2551] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:29:11.024677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d3cad-975a-4c9d-b273-66f879722af8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:11.034364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d3cad-975a-4c9d-b273-66f879722af8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:11.039306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5d8a5-bc3d-4639-8f31-b64e04b0f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:11.039910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5d8a5-bc3d-4639-8f31-b64e04b0f1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:11.040192 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5d8a5-bc3d-4639-8f31-b64e04b0f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:11.040495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5d8a5-bc3d-4639-8f31-b64e04b0f1b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:11.041139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5d8a5-bc3d-4639-8f31-b64e04b0f1b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:11.043126 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5d8a5-bc3d-4639-8f31-b64e04b0f1b0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:11.251812 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1279/2552] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:11 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:11.262691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75338f-5663-4eea-9d81-c39590943b38 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:11.269083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75338f-5663-4eea-9d81-c39590943b38 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:11.288476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:11.332905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b402a-5c90-41c4-8207-93839d7ead82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:11.333545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b402a-5c90-41c4-8207-93839d7ead82 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:11.333825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b402a-5c90-41c4-8207-93839d7ead82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:11.334100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b402a-5c90-41c4-8207-93839d7ead82 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:11.334786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b402a-5c90-41c4-8207-93839d7ead82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:11.336751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b402a-5c90-41c4-8207-93839d7ead82 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:11.451312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1274/2553] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:11 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:11.455502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5d8a5-bc3d-4639-8f31-b64e04b0f1b0 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:11.466849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5d8a5-bc3d-4639-8f31-b64e04b0f1b0 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:11.472262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598a239-b3c1-4614-8833-e2387353c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:11.473038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598a239-b3c1-4614-8833-e2387353c99d admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:11.473326 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598a239-b3c1-4614-8833-e2387353c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:11.473602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598a239-b3c1-4614-8833-e2387353c99d admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:11.474397 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598a239-b3c1-4614-8833-e2387353c99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:11.476811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598a239-b3c1-4614-8833-e2387353c99d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:11.508318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1280/2554] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:11.510647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b402a-5c90-41c4-8207-93839d7ead82 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:11.522857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b402a-5c90-41c4-8207-93839d7ead82 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:11.527560 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b4a46-3b17-4f52-81b7-58df24c785fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:11.528172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4a46-3b17-4f52-81b7-58df24c785fb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:11.528483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4a46-3b17-4f52-81b7-58df24c785fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:11.528757 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4a46-3b17-4f52-81b7-58df24c785fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:11.529407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b4a46-3b17-4f52-81b7-58df24c785fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:11.530998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b4a46-3b17-4f52-81b7-58df24c785fb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:11.542608 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1275/2555] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:11.547002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598a239-b3c1-4614-8833-e2387353c99d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:11.557590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598a239-b3c1-4614-8833-e2387353c99d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:11.563476 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e34ac7-efea-402b-8653-aa70227528bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:11.564142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e34ac7-efea-402b-8653-aa70227528bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:11.564463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e34ac7-efea-402b-8653-aa70227528bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:11.564817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e34ac7-efea-402b-8653-aa70227528bd admin admin] PATH_INFO: `/v3/projects/de97499284f94cb19c6b51bd2c308a90/users/e5d77fc8a71e4cc68cf3faa66dfbb164/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:11.581596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e34ac7-efea-402b-8653-aa70227528bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=de97499284f94cb19c6b51bd2c308a90, user_id=e5d77fc8a71e4cc68cf3faa66dfbb164, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:11.585278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e34ac7-efea-402b-8653-aa70227528bd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:11.667803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1281/2556] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:11 2022] PUT /identity/v3/projects/de97499284f94cb19c6b51bd2c308a90/users/e5d77fc8a71e4cc68cf3faa66dfbb164/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:11.678675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a705322-7925-4d54-bec9-b8a1a950e158 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:11.682200 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a705322-7925-4d54-bec9-b8a1a950e158 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:11.682200 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a705322-7925-4d54-bec9-b8a1a950e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:11.714196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7a705322-7925-4d54-bec9-b8a1a950e158 None None] MFA Rules not processed for user `e5d77fc8a71e4cc68cf3faa66dfbb164`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:11.716117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a705322-7925-4d54-bec9-b8a1a950e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:11.788674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1276/2557] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:11.793678 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e34ac7-efea-402b-8653-aa70227528bd admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:11.869599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e34ac7-efea-402b-8653-aa70227528bd admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:11.875288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729f1c3-893f-4c95-a179-21d5709bef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:11.878775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729f1c3-893f-4c95-a179-21d5709bef1a admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:11.878775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729f1c3-893f-4c95-a179-21d5709bef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:11.878775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729f1c3-893f-4c95-a179-21d5709bef1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:11.878775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729f1c3-893f-4c95-a179-21d5709bef1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:11.879954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729f1c3-893f-4c95-a179-21d5709bef1a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:11.966618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:11.972921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1282/2558] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:11 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:11.976934 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a705322-7925-4d54-bec9-b8a1a950e158 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:11.988389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a705322-7925-4d54-bec9-b8a1a950e158 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:12.053578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c938ab7-fa0a-4756-aa59-11759d045402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:12.054208 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c938ab7-fa0a-4756-aa59-11759d045402 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:12.054486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c938ab7-fa0a-4756-aa59-11759d045402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:12.054760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c938ab7-fa0a-4756-aa59-11759d045402 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:12.055406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c938ab7-fa0a-4756-aa59-11759d045402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:12.057449 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c938ab7-fa0a-4756-aa59-11759d045402 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:12.150565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1277/2559] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:11 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:12.151911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729f1c3-893f-4c95-a179-21d5709bef1a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:12.162721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729f1c3-893f-4c95-a179-21d5709bef1a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:12.167409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140ba6-e12d-4812-a983-1212aa3bc90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:12.168048 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140ba6-e12d-4812-a983-1212aa3bc90e admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:12.168595 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140ba6-e12d-4812-a983-1212aa3bc90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:12.168730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140ba6-e12d-4812-a983-1212aa3bc90e admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:12.169404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be140ba6-e12d-4812-a983-1212aa3bc90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:12.171004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be140ba6-e12d-4812-a983-1212aa3bc90e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:12.181878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1283/2560] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:12.186137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c938ab7-fa0a-4756-aa59-11759d045402 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:12.201192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c938ab7-fa0a-4756-aa59-11759d045402 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:12.206652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044c7d9-dfb5-4951-8c56-9c8cc75cf89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:12.207499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044c7d9-dfb5-4951-8c56-9c8cc75cf89d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:12.208163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044c7d9-dfb5-4951-8c56-9c8cc75cf89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:12.208677 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044c7d9-dfb5-4951-8c56-9c8cc75cf89d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:12.209532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044c7d9-dfb5-4951-8c56-9c8cc75cf89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:12.212884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044c7d9-dfb5-4951-8c56-9c8cc75cf89d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:12.225233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1278/2561] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:29:12.230240 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140ba6-e12d-4812-a983-1212aa3bc90e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:12.241235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140ba6-e12d-4812-a983-1212aa3bc90e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:12.251074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2592-5192-4a4c-8631-c22b41851cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:12.252361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2592-5192-4a4c-8631-c22b41851cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:12.252711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2592-5192-4a4c-8631-c22b41851cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:12.253071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2592-5192-4a4c-8631-c22b41851cc1 admin admin] PATH_INFO: `/v3/projects/f9e179a6492642d08fd0768f63196633/users/c39426ab12a74d758a814a99911a74dc/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:12.269898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b2592-5192-4a4c-8631-c22b41851cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e179a6492642d08fd0768f63196633, user_id=c39426ab12a74d758a814a99911a74dc, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:12.272862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b2592-5192-4a4c-8631-c22b41851cc1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:12.393281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1284/2562] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:12 2022] PUT /identity/v3/projects/f9e179a6492642d08fd0768f63196633/users/c39426ab12a74d758a814a99911a74dc/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:12.404263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d64ea-9084-44c5-87c7-d36477274ce0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:12.404620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d64ea-9084-44c5-87c7-d36477274ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:12.404960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d64ea-9084-44c5-87c7-d36477274ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:12.419227 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:12.434922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-902d64ea-9084-44c5-87c7-d36477274ce0 None None] MFA Rules not processed for user `c39426ab12a74d758a814a99911a74dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:12.436187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-902d64ea-9084-44c5-87c7-d36477274ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:12.501841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1279/2563] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:12.506503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2592-5192-4a4c-8631-c22b41851cc1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:12.576453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2592-5192-4a4c-8631-c22b41851cc1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:12.583491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3053b5-df46-4c44-83d2-cb3eb43025bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:12.584178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3053b5-df46-4c44-83d2-cb3eb43025bb admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:12.584562 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3053b5-df46-4c44-83d2-cb3eb43025bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:12.584909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3053b5-df46-4c44-83d2-cb3eb43025bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:12.585627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3053b5-df46-4c44-83d2-cb3eb43025bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:12.587648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3053b5-df46-4c44-83d2-cb3eb43025bb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:12.684171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1285/2564] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:12 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:12.688629 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d64ea-9084-44c5-87c7-d36477274ce0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:12.699059 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d64ea-9084-44c5-87c7-d36477274ce0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:12.761061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197d820-567a-4727-be46-a07ce14ff32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:12.761674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197d820-567a-4727-be46-a07ce14ff32c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:12.762570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197d820-567a-4727-be46-a07ce14ff32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:12.762845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197d820-567a-4727-be46-a07ce14ff32c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:12.763472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197d820-567a-4727-be46-a07ce14ff32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:12.765458 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197d820-567a-4727-be46-a07ce14ff32c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:12.859677 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1280/2565] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:12 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:12.861086 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3053b5-df46-4c44-83d2-cb3eb43025bb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:12.873171 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3053b5-df46-4c44-83d2-cb3eb43025bb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:12.877918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379fab6-c0e8-4fdb-8167-f386fb629742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:12.878524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379fab6-c0e8-4fdb-8167-f386fb629742 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:12.878804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379fab6-c0e8-4fdb-8167-f386fb629742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:12.879078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379fab6-c0e8-4fdb-8167-f386fb629742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:12.879720 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379fab6-c0e8-4fdb-8167-f386fb629742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:12.881352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379fab6-c0e8-4fdb-8167-f386fb629742 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:12.892717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1286/2566] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:12.896726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197d820-567a-4727-be46-a07ce14ff32c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:12.907287 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197d820-567a-4727-be46-a07ce14ff32c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:12.911980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74b6cb-348e-4105-81fc-eec90142f99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:12.912785 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74b6cb-348e-4105-81fc-eec90142f99a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:12.913065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74b6cb-348e-4105-81fc-eec90142f99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:12.913390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74b6cb-348e-4105-81fc-eec90142f99a admin admin] PATH_INFO: `/v3/projects/d39e250556384712b4eb8e1819d185f2/users/d7f368190a3a40188c71ec2d3215e5c5/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:12.929311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74b6cb-348e-4105-81fc-eec90142f99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39e250556384712b4eb8e1819d185f2, user_id=d7f368190a3a40188c71ec2d3215e5c5, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:12.931989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74b6cb-348e-4105-81fc-eec90142f99a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:13.022277 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1281/2567] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:12 2022] PUT /identity/v3/projects/d39e250556384712b4eb8e1819d185f2/users/d7f368190a3a40188c71ec2d3215e5c5/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:13.026370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379fab6-c0e8-4fdb-8167-f386fb629742 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:13.040350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379fab6-c0e8-4fdb-8167-f386fb629742 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:13.107598 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef3e75-ef48-4c4a-8135-6da908159d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:13.108356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3e75-ef48-4c4a-8135-6da908159d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:13.108755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3e75-ef48-4c4a-8135-6da908159d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:13.109102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3e75-ef48-4c4a-8135-6da908159d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:13.109838 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef3e75-ef48-4c4a-8135-6da908159d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:13.111650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef3e75-ef48-4c4a-8135-6da908159d5c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:13.123807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1287/2568] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:13.128001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74b6cb-348e-4105-81fc-eec90142f99a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:13.143029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74b6cb-348e-4105-81fc-eec90142f99a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:13.148981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e83b6-e965-4032-bc30-ec05fcbccb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:13.149767 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e83b6-e965-4032-bc30-ec05fcbccb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:13.150177 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e83b6-e965-4032-bc30-ec05fcbccb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:13.150554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e83b6-e965-4032-bc30-ec05fcbccb1d admin admin] PATH_INFO: `/v3/projects/d39e250556384712b4eb8e1819d185f2/users/d7f368190a3a40188c71ec2d3215e5c5/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:13.153632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e83b6-e965-4032-bc30-ec05fcbccb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39e250556384712b4eb8e1819d185f2, user_id=d7f368190a3a40188c71ec2d3215e5c5, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:13.159173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e83b6-e965-4032-bc30-ec05fcbccb1d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:13.174311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1282/2569] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:13 2022] PUT /identity/v3/projects/d39e250556384712b4eb8e1819d185f2/users/d7f368190a3a40188c71ec2d3215e5c5/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:13.250979 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00407ad-53ad-4ae6-8008-48d127293e78 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:13.251265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00407ad-53ad-4ae6-8008-48d127293e78 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:13.251548 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00407ad-53ad-4ae6-8008-48d127293e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:13.294617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f00407ad-53ad-4ae6-8008-48d127293e78 None None] MFA Rules not processed for user `d7f368190a3a40188c71ec2d3215e5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:13.295924 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f00407ad-53ad-4ae6-8008-48d127293e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:13.328098 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:13.385226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1288/2570] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:13.394416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e83b6-e965-4032-bc30-ec05fcbccb1d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:13.395032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7d8e83b6-e965-4032-bc30-ec05fcbccb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:13.452307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:13.456791 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e83b6-e965-4032-bc30-ec05fcbccb1d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:13.460403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78304f-118c-4ad5-8cad-1b1629c7a064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:13.461035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78304f-118c-4ad5-8cad-1b1629c7a064 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:13.466984 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78304f-118c-4ad5-8cad-1b1629c7a064 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:13.466984 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78304f-118c-4ad5-8cad-1b1629c7a064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:13.524198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78304f-118c-4ad5-8cad-1b1629c7a064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:13.525741 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78304f-118c-4ad5-8cad-1b1629c7a064 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:13.549637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1283/2571] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:13.829880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00407ad-53ad-4ae6-8008-48d127293e78 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:13.831538 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f00407ad-53ad-4ae6-8008-48d127293e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:13.929130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00407ad-53ad-4ae6-8008-48d127293e78 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:13.933865 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:13.934512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:13.934796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:13.935071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] PATH_INFO: `/v3/users/7699159c5e67464ba6b82ec848c24439` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:13.952360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7699159c5e67464ba6b82ec848c24439)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:13.954409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:14.124314 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7699159c5e67464ba6b82ec848c24439'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:14.131046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7699159c5e67464ba6b82ec848c24439'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:14.131702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7699159c5e67464ba6b82ec848c24439'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:14.192546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7699159c5e67464ba6b82ec848c24439'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:14.206715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3a0a9312-dd7d-4967-b80b-de8d3f44609a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7699159c5e67464ba6b82ec848c24439'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:14.212831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1289/2572] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:13 2022] DELETE /identity/v3/users/7699159c5e67464ba6b82ec848c24439 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:14.501157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78304f-118c-4ad5-8cad-1b1629c7a064 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:14.516980 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78304f-118c-4ad5-8cad-1b1629c7a064 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:14.580587 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:14.581224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:14.581504 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:14.581777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] PATH_INFO: `/v3/projects/e814d8e27b4144eca0c5721162bee5ee` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:14.593262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e814d8e27b4144eca0c5721162bee5ee)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:14.595241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:14.803354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e814d8e27b4144eca0c5721162bee5ee', 'request_id': 'req-00099d0f-acb8-4b92-b312-37b9951d8168'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:14.810831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e814d8e27b4144eca0c5721162bee5ee', 'request_id': 'req-00099d0f-acb8-4b92-b312-37b9951d8168'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:14.816797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e814d8e27b4144eca0c5721162bee5ee', 'request_id': 'req-00099d0f-acb8-4b92-b312-37b9951d8168'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:14.946575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] The token cache is being invalidate because project e814d8e27b4144eca0c5721162bee5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:14.946876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:14.947534 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00099d0f-acb8-4b92-b312-37b9951d8168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:14.949183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1284/2573] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:14 2022] DELETE /identity/v3/projects/e814d8e27b4144eca0c5721162bee5ee => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:14.954630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdce66-a51f-4770-ae23-079b7b4a5033 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:14.954946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdce66-a51f-4770-ae23-079b7b4a5033 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:14.955227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdce66-a51f-4770-ae23-079b7b4a5033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:14.974999 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-72fdce66-a51f-4770-ae23-079b7b4a5033 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:14.976202 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-72fdce66-a51f-4770-ae23-079b7b4a5033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:15.000978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:15.035545 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1290/2574] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:15.044101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345282c-c9c1-48d6-847d-fad4aa1ef1b9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.044480 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345282c-c9c1-48d6-847d-fad4aa1ef1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.044758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345282c-c9c1-48d6-847d-fad4aa1ef1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.068768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5345282c-c9c1-48d6-847d-fad4aa1ef1b9 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:15.068768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5345282c-c9c1-48d6-847d-fad4aa1ef1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:15.073991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1285/2575] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:15.078145 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdce66-a51f-4770-ae23-079b7b4a5033 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:15.087683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdce66-a51f-4770-ae23-079b7b4a5033 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:15.093203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d33d54-cd45-4ca1-9e65-d8e306ed0133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:15.093831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d33d54-cd45-4ca1-9e65-d8e306ed0133 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.094116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d33d54-cd45-4ca1-9e65-d8e306ed0133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.094395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d33d54-cd45-4ca1-9e65-d8e306ed0133 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.095077 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d33d54-cd45-4ca1-9e65-d8e306ed0133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:29:15.095384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d33d54-cd45-4ca1-9e65-d8e306ed0133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:15.097071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d33d54-cd45-4ca1-9e65-d8e306ed0133 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:15.109432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1291/2576] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:29:15.113571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345282c-c9c1-48d6-847d-fad4aa1ef1b9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:15.123606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345282c-c9c1-48d6-847d-fad4aa1ef1b9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:15.128329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c8f8e-dc6d-4e2c-83e2-a575d5a7f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:15.131622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c8f8e-dc6d-4e2c-83e2-a575d5a7f55f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.131622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c8f8e-dc6d-4e2c-83e2-a575d5a7f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.131622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c8f8e-dc6d-4e2c-83e2-a575d5a7f55f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.131622 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c8f8e-dc6d-4e2c-83e2-a575d5a7f55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:15.132031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c8f8e-dc6d-4e2c-83e2-a575d5a7f55f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:15.147657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:15.227533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1286/2577] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:15 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:15.232229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d33d54-cd45-4ca1-9e65-d8e306ed0133 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:15.242088 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d33d54-cd45-4ca1-9e65-d8e306ed0133 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:15.298553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58a0fa-6456-4e94-ae1a-f6f4a026c78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:15.299162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a0fa-6456-4e94-ae1a-f6f4a026c78e admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.299521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a0fa-6456-4e94-ae1a-f6f4a026c78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.299799 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58a0fa-6456-4e94-ae1a-f6f4a026c78e admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.300472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58a0fa-6456-4e94-ae1a-f6f4a026c78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:15.302434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58a0fa-6456-4e94-ae1a-f6f4a026c78e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:15.420074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1292/2578] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:15 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:15.421073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c8f8e-dc6d-4e2c-83e2-a575d5a7f55f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:15.432028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c8f8e-dc6d-4e2c-83e2-a575d5a7f55f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:15.439119 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cd19a-262f-411c-ae16-2068aec8b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:15.442870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cd19a-262f-411c-ae16-2068aec8b6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.442870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cd19a-262f-411c-ae16-2068aec8b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.442870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cd19a-262f-411c-ae16-2068aec8b6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.442870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cd19a-262f-411c-ae16-2068aec8b6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:15.442870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cd19a-262f-411c-ae16-2068aec8b6d5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:15.452723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1287/2579] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:15.456899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58a0fa-6456-4e94-ae1a-f6f4a026c78e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:15.467321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58a0fa-6456-4e94-ae1a-f6f4a026c78e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:15.471919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71ccd5-03d7-4bbb-a8a4-0da2d7b297b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:15.472551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71ccd5-03d7-4bbb-a8a4-0da2d7b297b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.472834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71ccd5-03d7-4bbb-a8a4-0da2d7b297b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.473106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71ccd5-03d7-4bbb-a8a4-0da2d7b297b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.473770 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71ccd5-03d7-4bbb-a8a4-0da2d7b297b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:15.475317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71ccd5-03d7-4bbb-a8a4-0da2d7b297b8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:15.486500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1293/2580] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:15.490679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cd19a-262f-411c-ae16-2068aec8b6d5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:15.500791 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cd19a-262f-411c-ae16-2068aec8b6d5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:15.505300 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c32b1-c5b6-450f-8f42-ca394966efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:15.505930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c32b1-c5b6-450f-8f42-ca394966efc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.506205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c32b1-c5b6-450f-8f42-ca394966efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.506476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c32b1-c5b6-450f-8f42-ca394966efc4 admin admin] PATH_INFO: `/v3/projects/74c5bf3a826f4742b3c648e406bc4421/users/26cef75e4ee74625ba300f64daf98b09/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.520670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c32b1-c5b6-450f-8f42-ca394966efc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c5bf3a826f4742b3c648e406bc4421, user_id=26cef75e4ee74625ba300f64daf98b09, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:15.523354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c32b1-c5b6-450f-8f42-ca394966efc4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:15.627150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1288/2581] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:15 2022] PUT /identity/v3/projects/74c5bf3a826f4742b3c648e406bc4421/users/26cef75e4ee74625ba300f64daf98b09/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:15.637676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3ffe-a964-4b37-9308-21664101182b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.638047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3ffe-a964-4b37-9308-21664101182b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.638327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3ffe-a964-4b37-9308-21664101182b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.645158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c32b1-c5b6-450f-8f42-ca394966efc4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:15.646819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6c1c32b1-c5b6-450f-8f42-ca394966efc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:15.673769 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-175a3ffe-a964-4b37-9308-21664101182b None None] MFA Rules not processed for user `26cef75e4ee74625ba300f64daf98b09`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:15.675036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-175a3ffe-a964-4b37-9308-21664101182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:15.710474 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c32b1-c5b6-450f-8f42-ca394966efc4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:15.714186 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455da3d-8ff2-467a-a353-f5bdfcc6eab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:15.715298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455da3d-8ff2-467a-a353-f5bdfcc6eab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.715580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455da3d-8ff2-467a-a353-f5bdfcc6eab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.715857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455da3d-8ff2-467a-a353-f5bdfcc6eab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.717681 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d455da3d-8ff2-467a-a353-f5bdfcc6eab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:15.738749 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1294/2582] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:15.743607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a3ffe-a964-4b37-9308-21664101182b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:15.769652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:15.792442 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455da3d-8ff2-467a-a353-f5bdfcc6eab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:15.794569 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455da3d-8ff2-467a-a353-f5bdfcc6eab0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:15.804914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a3ffe-a964-4b37-9308-21664101182b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:15.806078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1289/2583] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:29:15.809743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5d6c9-5379-439c-99cb-8d699b82a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:15.810352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5d6c9-5379-439c-99cb-8d699b82a422 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.811677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5d6c9-5379-439c-99cb-8d699b82a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.811677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5d6c9-5379-439c-99cb-8d699b82a422 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.811677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5d6c9-5379-439c-99cb-8d699b82a422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:15.813521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5d6c9-5379-439c-99cb-8d699b82a422 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:15.926362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1295/2584] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:15 2022] POST /identity/v3/projects => generated 363 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:15.927714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455da3d-8ff2-467a-a353-f5bdfcc6eab0 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:15.938179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455da3d-8ff2-467a-a353-f5bdfcc6eab0 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:15.994396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267cb35-95a0-4d65-9115-0b7e29272a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:15.995001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267cb35-95a0-4d65-9115-0b7e29272a1d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:15.995284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267cb35-95a0-4d65-9115-0b7e29272a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:15.995561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267cb35-95a0-4d65-9115-0b7e29272a1d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:15.996189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267cb35-95a0-4d65-9115-0b7e29272a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:15.998132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267cb35-95a0-4d65-9115-0b7e29272a1d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:16.006999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:16.115644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1290/2585] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:15 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:16.119932 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5d6c9-5379-439c-99cb-8d699b82a422 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:16.130490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5d6c9-5379-439c-99cb-8d699b82a422 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:16.135299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc47e8-d3d7-4a32-b7a0-bcc60278218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:16.135902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc47e8-d3d7-4a32-b7a0-bcc60278218a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:16.136187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc47e8-d3d7-4a32-b7a0-bcc60278218a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:16.136494 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc47e8-d3d7-4a32-b7a0-bcc60278218a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:16.137648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc47e8-d3d7-4a32-b7a0-bcc60278218a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:16.139292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc47e8-d3d7-4a32-b7a0-bcc60278218a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:16.149383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1296/2586] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:16.154054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267cb35-95a0-4d65-9115-0b7e29272a1d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:16.163923 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267cb35-95a0-4d65-9115-0b7e29272a1d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:16.169029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb747a-ced2-43a4-9157-0ca982189a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:16.169754 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb747a-ced2-43a4-9157-0ca982189a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:16.170038 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb747a-ced2-43a4-9157-0ca982189a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:16.170314 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb747a-ced2-43a4-9157-0ca982189a93 admin admin] PATH_INFO: `/v3/projects/e213cfb78f6542d4bbb138ff1cf5be4b/users/35cfe42fe48f4be7b229380a0ff47b1b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:16.186010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb747a-ced2-43a4-9157-0ca982189a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e213cfb78f6542d4bbb138ff1cf5be4b, user_id=35cfe42fe48f4be7b229380a0ff47b1b, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:16.188774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb747a-ced2-43a4-9157-0ca982189a93 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:16.270068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1291/2587] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:16 2022] PUT /identity/v3/projects/e213cfb78f6542d4bbb138ff1cf5be4b/users/35cfe42fe48f4be7b229380a0ff47b1b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:16.274152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc47e8-d3d7-4a32-b7a0-bcc60278218a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:16.284470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc47e8-d3d7-4a32-b7a0-bcc60278218a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:16.340033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1e0fa-770a-46a6-a846-87403aea84f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:16.340669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e0fa-770a-46a6-a846-87403aea84f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:16.341078 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e0fa-770a-46a6-a846-87403aea84f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:16.341358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e0fa-770a-46a6-a846-87403aea84f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:16.342044 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1e0fa-770a-46a6-a846-87403aea84f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:16.343626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1e0fa-770a-46a6-a846-87403aea84f9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:16.353603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1297/2588] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:16.357893 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb747a-ced2-43a4-9157-0ca982189a93 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:16.368974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb747a-ced2-43a4-9157-0ca982189a93 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:16.374876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912e905-01d0-42b6-b7df-e37c2a4ba469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:16.375361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912e905-01d0-42b6-b7df-e37c2a4ba469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:16.375634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912e905-01d0-42b6-b7df-e37c2a4ba469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:16.375905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912e905-01d0-42b6-b7df-e37c2a4ba469 admin admin] PATH_INFO: `/v3/projects/e213cfb78f6542d4bbb138ff1cf5be4b/users/35cfe42fe48f4be7b229380a0ff47b1b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:16.377824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912e905-01d0-42b6-b7df-e37c2a4ba469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e213cfb78f6542d4bbb138ff1cf5be4b, user_id=35cfe42fe48f4be7b229380a0ff47b1b, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:16.380444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912e905-01d0-42b6-b7df-e37c2a4ba469 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:16.391623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1292/2589] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:16 2022] PUT /identity/v3/projects/e213cfb78f6542d4bbb138ff1cf5be4b/users/35cfe42fe48f4be7b229380a0ff47b1b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:16.403066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947e1b7-99e7-4c96-bfb0-eaaf5c646d76 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:16.403376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947e1b7-99e7-4c96-bfb0-eaaf5c646d76 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:16.403648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947e1b7-99e7-4c96-bfb0-eaaf5c646d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:16.431083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6947e1b7-99e7-4c96-bfb0-eaaf5c646d76 None None] MFA Rules not processed for user `35cfe42fe48f4be7b229380a0ff47b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:16.432260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6947e1b7-99e7-4c96-bfb0-eaaf5c646d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:16.524707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1298/2590] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:16.535963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912e905-01d0-42b6-b7df-e37c2a4ba469 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:16.537942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3912e905-01d0-42b6-b7df-e37c2a4ba469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:16.599141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912e905-01d0-42b6-b7df-e37c2a4ba469 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:16.602949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4f653-aa65-4c8e-8a3d-2b72eaee78e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:16.603689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f653-aa65-4c8e-8a3d-2b72eaee78e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:16.604051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f653-aa65-4c8e-8a3d-2b72eaee78e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:16.604464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f653-aa65-4c8e-8a3d-2b72eaee78e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:16.614189 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4f653-aa65-4c8e-8a3d-2b72eaee78e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:16.615695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4f653-aa65-4c8e-8a3d-2b72eaee78e0 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:16.626606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1293/2591] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:16.741447 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947e1b7-99e7-4c96-bfb0-eaaf5c646d76 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:16.743187 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6947e1b7-99e7-4c96-bfb0-eaaf5c646d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:16.755996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947e1b7-99e7-4c96-bfb0-eaaf5c646d76 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:16.759779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e41daf-37f7-4e53-a944-a1dd1a2df7cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:16.760498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e41daf-37f7-4e53-a944-a1dd1a2df7cb service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:16.760912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e41daf-37f7-4e53-a944-a1dd1a2df7cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:16.761257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e41daf-37f7-4e53-a944-a1dd1a2df7cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:16.763188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-54e41daf-37f7-4e53-a944-a1dd1a2df7cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:16.783654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:16.833348 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e41daf-37f7-4e53-a944-a1dd1a2df7cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:16.834814 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e41daf-37f7-4e53-a944-a1dd1a2df7cb service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:16.844037 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1299/2592] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:16.868773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4f653-aa65-4c8e-8a3d-2b72eaee78e0 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:16.879869 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4f653-aa65-4c8e-8a3d-2b72eaee78e0 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:16.883838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf68d-6b59-4bb3-b33f-89e59112d98c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:16.884661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf68d-6b59-4bb3-b33f-89e59112d98c service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:16.884858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf68d-6b59-4bb3-b33f-89e59112d98c service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:16.885158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf68d-6b59-4bb3-b33f-89e59112d98c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:16.958344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf68d-6b59-4bb3-b33f-89e59112d98c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:16.960080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf68d-6b59-4bb3-b33f-89e59112d98c service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:16.984320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1294/2593] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:18.143207 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e41daf-37f7-4e53-a944-a1dd1a2df7cb service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:18.328593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e41daf-37f7-4e53-a944-a1dd1a2df7cb service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:18.331245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102fd5a-618d-4de2-a921-435997a9c0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:18.331860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102fd5a-618d-4de2-a921-435997a9c0ed service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:18.332137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102fd5a-618d-4de2-a921-435997a9c0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:18.332464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102fd5a-618d-4de2-a921-435997a9c0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:18.334224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6102fd5a-618d-4de2-a921-435997a9c0ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:18.406497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102fd5a-618d-4de2-a921-435997a9c0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:18.407907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102fd5a-618d-4de2-a921-435997a9c0ed service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:18.418672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1300/2594] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:18.439713 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf68d-6b59-4bb3-b33f-89e59112d98c service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:18.448756 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf68d-6b59-4bb3-b33f-89e59112d98c service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:18.456441 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aa7ac-d62c-4577-8a62-b35977365247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:18.457128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aa7ac-d62c-4577-8a62-b35977365247 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:18.457475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aa7ac-d62c-4577-8a62-b35977365247 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:18.457817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aa7ac-d62c-4577-8a62-b35977365247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:18.459572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-660aa7ac-d62c-4577-8a62-b35977365247 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:18.514124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:18.526379 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aa7ac-d62c-4577-8a62-b35977365247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:18.528346 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aa7ac-d62c-4577-8a62-b35977365247 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:18.540822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1295/2595] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:20.796477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102fd5a-618d-4de2-a921-435997a9c0ed service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:20.859259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102fd5a-618d-4de2-a921-435997a9c0ed service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:20.863849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:20.864502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:20.864804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:20.865079 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] PATH_INFO: `/v3/users/26cef75e4ee74625ba300f64daf98b09` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:20.866189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26cef75e4ee74625ba300f64daf98b09)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:20.868404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:20.869917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:21.106779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26cef75e4ee74625ba300f64daf98b09'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:21.114547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26cef75e4ee74625ba300f64daf98b09'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:21.115158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26cef75e4ee74625ba300f64daf98b09'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:21.203433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26cef75e4ee74625ba300f64daf98b09'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:21.215705 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26cef75e4ee74625ba300f64daf98b09'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:21.222297 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1301/2596] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:20 2022] DELETE /identity/v3/users/26cef75e4ee74625ba300f64daf98b09 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:21.226810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d3b7-ed38-4eb6-b8a9-445ecf671285 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:21.227395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d3b7-ed38-4eb6-b8a9-445ecf671285 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:21.227395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d3b7-ed38-4eb6-b8a9-445ecf671285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:21.247819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cde8d3b7-ed38-4eb6-b8a9-445ecf671285 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:21.256238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cde8d3b7-ed38-4eb6-b8a9-445ecf671285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:21.306222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1296/2597] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:21.316683 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:21.318067 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:21.375193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00524b2-625f-470e-ba4f-01b7ed571e39 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:21.378793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fdfab-114a-49f4-8165-7cb74bc802d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:21.379383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fdfab-114a-49f4-8165-7cb74bc802d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:21.379661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fdfab-114a-49f4-8165-7cb74bc802d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:21.379935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fdfab-114a-49f4-8165-7cb74bc802d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:21.389655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fdfab-114a-49f4-8165-7cb74bc802d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:21.391120 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fdfab-114a-49f4-8165-7cb74bc802d9 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:21.400827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1302/2598] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:29:21.851219 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d3b7-ed38-4eb6-b8a9-445ecf671285 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:21.852673 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cde8d3b7-ed38-4eb6-b8a9-445ecf671285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:21.867702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d3b7-ed38-4eb6-b8a9-445ecf671285 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:21.873283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:21.873937 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:21.874752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:21.875460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] PATH_INFO: `/v3/projects/74c5bf3a826f4742b3c648e406bc4421` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:21.876727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c5bf3a826f4742b3c648e406bc4421)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:21.878635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:21.994243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c5bf3a826f4742b3c648e406bc4421', 'request_id': 'req-a5948d6b-74de-4210-ba1f-77a7129f3981'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:22.000620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c5bf3a826f4742b3c648e406bc4421', 'request_id': 'req-a5948d6b-74de-4210-ba1f-77a7129f3981'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:22.006413 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c5bf3a826f4742b3c648e406bc4421', 'request_id': 'req-a5948d6b-74de-4210-ba1f-77a7129f3981'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:22.111864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] The token cache is being invalidate because project 74c5bf3a826f4742b3c648e406bc4421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:22.112150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:22.112805 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:22.114354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1297/2599] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:21 2022] DELETE /identity/v3/projects/74c5bf3a826f4742b3c648e406bc4421 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:22.118712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fdfab-114a-49f4-8165-7cb74bc802d9 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:22.128642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fdfab-114a-49f4-8165-7cb74bc802d9 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:22.190107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:22.190748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:22.195102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:22.195102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] PATH_INFO: `/v3/users/35cfe42fe48f4be7b229380a0ff47b1b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:22.195102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cfe42fe48f4be7b229380a0ff47b1b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:22.195102 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:22.218104 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:22.377690 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cfe42fe48f4be7b229380a0ff47b1b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:22.384491 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cfe42fe48f4be7b229380a0ff47b1b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:22.385222 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cfe42fe48f4be7b229380a0ff47b1b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:22.437513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cfe42fe48f4be7b229380a0ff47b1b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:22.450153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cfe42fe48f4be7b229380a0ff47b1b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:22.456007 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1303/2600] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:22 2022] DELETE /identity/v3/users/35cfe42fe48f4be7b229380a0ff47b1b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:22.863286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:22.865366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:22.889533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948d6b-74de-4210-ba1f-77a7129f3981 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:22.945539 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:22.945960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:22.946236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:22.946510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] PATH_INFO: `/v3/projects/e213cfb78f6542d4bbb138ff1cf5be4b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:22.947617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e213cfb78f6542d4bbb138ff1cf5be4b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:22.949576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:22.965354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:23.084123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e213cfb78f6542d4bbb138ff1cf5be4b', 'request_id': 'req-c053d28a-c143-49bd-bc9a-3cc7e0911156'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:23.090844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e213cfb78f6542d4bbb138ff1cf5be4b', 'request_id': 'req-c053d28a-c143-49bd-bc9a-3cc7e0911156'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:23.096482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e213cfb78f6542d4bbb138ff1cf5be4b', 'request_id': 'req-c053d28a-c143-49bd-bc9a-3cc7e0911156'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:23.113543 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:23.115093 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:23.172359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c9998-25ab-47f8-8529-ba38de926682 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:23.177906 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] The token cache is being invalidate because project e213cfb78f6542d4bbb138ff1cf5be4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:23.178195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:23.178819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c053d28a-c143-49bd-bc9a-3cc7e0911156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:23.180580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1298/2601] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:22 2022] DELETE /identity/v3/projects/e213cfb78f6542d4bbb138ff1cf5be4b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:23.185005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62986c83-caa4-4536-90d5-467837b195b3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.185274 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62986c83-caa4-4536-90d5-467837b195b3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.185551 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62986c83-caa4-4536-90d5-467837b195b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.206133 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-62986c83-caa4-4536-90d5-467837b195b3 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:23.207411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-62986c83-caa4-4536-90d5-467837b195b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:23.226235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de31f4-aa9c-4994-a8a0-70f9cf9b6296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:23.226932 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de31f4-aa9c-4994-a8a0-70f9cf9b6296 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.231146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de31f4-aa9c-4994-a8a0-70f9cf9b6296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.231146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de31f4-aa9c-4994-a8a0-70f9cf9b6296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.231146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-21de31f4-aa9c-4994-a8a0-70f9cf9b6296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:23.282878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1299/2602] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:23.283829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62986c83-caa4-4536-90d5-467837b195b3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:23.285544 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-62986c83-caa4-4536-90d5-467837b195b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:23.298831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62986c83-caa4-4536-90d5-467837b195b3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:23.303052 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de31f4-aa9c-4994-a8a0-70f9cf9b6296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:23.303052 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de31f4-aa9c-4994-a8a0-70f9cf9b6296 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:23.303966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:23.304743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.305105 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.305284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] PATH_INFO: `/v3/users/e5d77fc8a71e4cc68cf3faa66dfbb164` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.306435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d77fc8a71e4cc68cf3faa66dfbb164)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:23.308400 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:23.314325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1304/2603] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:29:23.315326 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2577b-00ec-4d6d-85c9-1d0e62d060f8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.315607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2577b-00ec-4d6d-85c9-1d0e62d060f8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.315877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2577b-00ec-4d6d-85c9-1d0e62d060f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.331661 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:23.338230 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f2a2577b-00ec-4d6d-85c9-1d0e62d060f8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:23.340409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f2a2577b-00ec-4d6d-85c9-1d0e62d060f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:23.349702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1305/2604] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:23.353870 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2577b-00ec-4d6d-85c9-1d0e62d060f8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:23.362946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2577b-00ec-4d6d-85c9-1d0e62d060f8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:23.367886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89906ca1-4a59-467a-8aad-62a4842d69d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:23.368533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89906ca1-4a59-467a-8aad-62a4842d69d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.368789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89906ca1-4a59-467a-8aad-62a4842d69d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.369059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89906ca1-4a59-467a-8aad-62a4842d69d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.369712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89906ca1-4a59-467a-8aad-62a4842d69d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:29:23.370014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89906ca1-4a59-467a-8aad-62a4842d69d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:23.371658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89906ca1-4a59-467a-8aad-62a4842d69d8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:23.384161 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1306/2605] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:29:23.388840 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89906ca1-4a59-467a-8aad-62a4842d69d8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:23.398379 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89906ca1-4a59-467a-8aad-62a4842d69d8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:23.404312 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01e04d-bfbf-4a0f-894b-9f5142903757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:23.408898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e04d-bfbf-4a0f-894b-9f5142903757 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.408898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e04d-bfbf-4a0f-894b-9f5142903757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.408898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e04d-bfbf-4a0f-894b-9f5142903757 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.408898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01e04d-bfbf-4a0f-894b-9f5142903757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:23.408898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01e04d-bfbf-4a0f-894b-9f5142903757 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:23.513750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d77fc8a71e4cc68cf3faa66dfbb164'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:23.522285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d77fc8a71e4cc68cf3faa66dfbb164'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:23.526909 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1307/2606] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:23 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:23.531739 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01e04d-bfbf-4a0f-894b-9f5142903757 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:23.594596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01e04d-bfbf-4a0f-894b-9f5142903757 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:23.598624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d77fc8a71e4cc68cf3faa66dfbb164'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:23.599095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d77fc8a71e4cc68cf3faa66dfbb164'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:23.599929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-401d71bb-e940-4c45-9327-51d2e004a6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d77fc8a71e4cc68cf3faa66dfbb164'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:23.600520 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b27bd-4003-4398-a44c-65070bbcd35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:23.600901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b27bd-4003-4398-a44c-65070bbcd35d admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.601183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b27bd-4003-4398-a44c-65070bbcd35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.601459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b27bd-4003-4398-a44c-65070bbcd35d admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.602157 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b27bd-4003-4398-a44c-65070bbcd35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:23.604126 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b27bd-4003-4398-a44c-65070bbcd35d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:23.621893 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1300/2607] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:23 2022] DELETE /identity/v3/users/e5d77fc8a71e4cc68cf3faa66dfbb164 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:23.626658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb161-7a47-479a-a328-8d5b8057f692 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.627564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb161-7a47-479a-a328-8d5b8057f692 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.627564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb161-7a47-479a-a328-8d5b8057f692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.652034 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-be5bb161-7a47-479a-a328-8d5b8057f692 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:23.653793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-be5bb161-7a47-479a-a328-8d5b8057f692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:23.663139 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:23.678779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1308/2608] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:23 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:23.686966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b27bd-4003-4398-a44c-65070bbcd35d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:23.688757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1b4b27bd-4003-4398-a44c-65070bbcd35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:23.706653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b27bd-4003-4398-a44c-65070bbcd35d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:23.725057 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1301/2609] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:23.734765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bb161-7a47-479a-a328-8d5b8057f692 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:23.736358 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-be5bb161-7a47-479a-a328-8d5b8057f692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:23.778927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a70fd0-6c1a-46a0-9257-4ae780f96409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:23.779551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a70fd0-6c1a-46a0-9257-4ae780f96409 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.779836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a70fd0-6c1a-46a0-9257-4ae780f96409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.780112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a70fd0-6c1a-46a0-9257-4ae780f96409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.780804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a70fd0-6c1a-46a0-9257-4ae780f96409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:23.782421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a70fd0-6c1a-46a0-9257-4ae780f96409 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:23.793065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1309/2610] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:23.797735 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a70fd0-6c1a-46a0-9257-4ae780f96409 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:23.804755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bb161-7a47-479a-a328-8d5b8057f692 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:23.809058 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebdab0-051a-4d3f-80c5-f97ecf5ad10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:23.809440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a70fd0-6c1a-46a0-9257-4ae780f96409 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:23.809674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebdab0-051a-4d3f-80c5-f97ecf5ad10e service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.809983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebdab0-051a-4d3f-80c5-f97ecf5ad10e service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.810258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebdab0-051a-4d3f-80c5-f97ecf5ad10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.814992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4adc56-5004-480a-b98b-0d402bc1eca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:23.815746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4adc56-5004-480a-b98b-0d402bc1eca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.816033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4adc56-5004-480a-b98b-0d402bc1eca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.816315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4adc56-5004-480a-b98b-0d402bc1eca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.816962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4adc56-5004-480a-b98b-0d402bc1eca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:23.819704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4adc56-5004-480a-b98b-0d402bc1eca4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:23.821218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebdab0-051a-4d3f-80c5-f97ecf5ad10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:23.822481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebdab0-051a-4d3f-80c5-f97ecf5ad10e service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:23.831006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1310/2611] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:29:23.834826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4adc56-5004-480a-b98b-0d402bc1eca4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:23.838769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1302/2612] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:29:23.847033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4adc56-5004-480a-b98b-0d402bc1eca4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:23.855362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58950384-f10b-4807-ab57-e110062f060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:23.858466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58950384-f10b-4807-ab57-e110062f060a admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:23.858466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58950384-f10b-4807-ab57-e110062f060a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:23.858466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58950384-f10b-4807-ab57-e110062f060a admin admin] PATH_INFO: `/v3/projects/da94130fbd12425e9e0b7ef4617d1f99/users/5c2623878dd44ed084272c593ae5dedb/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:23.875299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58950384-f10b-4807-ab57-e110062f060a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da94130fbd12425e9e0b7ef4617d1f99, user_id=5c2623878dd44ed084272c593ae5dedb, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:23.878795 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58950384-f10b-4807-ab57-e110062f060a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:23.987227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1311/2613] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:23 2022] PUT /identity/v3/projects/da94130fbd12425e9e0b7ef4617d1f99/users/5c2623878dd44ed084272c593ae5dedb/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:23.999683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a03a-3979-4183-82e4-abf7aecf50d6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:24.000185 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a03a-3979-4183-82e4-abf7aecf50d6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:24.000310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a03a-3979-4183-82e4-abf7aecf50d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:24.035303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-58d3a03a-3979-4183-82e4-abf7aecf50d6 None None] MFA Rules not processed for user `5c2623878dd44ed084272c593ae5dedb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:24.036751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58d3a03a-3979-4183-82e4-abf7aecf50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:24.117217 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1303/2614] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:24.126599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58950384-f10b-4807-ab57-e110062f060a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:24.148156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:24.194641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58950384-f10b-4807-ab57-e110062f060a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:24.199627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd12290-4ab9-4ad8-af95-028e66f6aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:24.200253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd12290-4ab9-4ad8-af95-028e66f6aa9e admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:24.200541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd12290-4ab9-4ad8-af95-028e66f6aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:24.200817 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd12290-4ab9-4ad8-af95-028e66f6aa9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:24.201489 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd12290-4ab9-4ad8-af95-028e66f6aa9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:24.203441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd12290-4ab9-4ad8-af95-028e66f6aa9e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:24.298267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3a03a-3979-4183-82e4-abf7aecf50d6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:24.298267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58d3a03a-3979-4183-82e4-abf7aecf50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:24.320131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1312/2615] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:24 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:24.321279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3a03a-3979-4183-82e4-abf7aecf50d6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:24.325565 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd12290-4ab9-4ad8-af95-028e66f6aa9e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:24.388352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:24.400153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd12290-4ab9-4ad8-af95-028e66f6aa9e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:24.405872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62709fa-b08d-417b-af7b-6fbb79d12ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:24.406067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:24.406482 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62709fa-b08d-417b-af7b-6fbb79d12ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:24.406823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62709fa-b08d-417b-af7b-6fbb79d12ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:24.407114 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62709fa-b08d-417b-af7b-6fbb79d12ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:24.407498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:24.407916 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62709fa-b08d-417b-af7b-6fbb79d12ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:24.408841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:24.409289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] PATH_INFO: `/v3/projects/de97499284f94cb19c6b51bd2c308a90` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:24.410101 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62709fa-b08d-417b-af7b-6fbb79d12ab2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:24.411141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de97499284f94cb19c6b51bd2c308a90)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:24.413424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:24.498863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1313/2616] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:24 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:24.500202 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62709fa-b08d-417b-af7b-6fbb79d12ab2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:24.510230 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62709fa-b08d-417b-af7b-6fbb79d12ab2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:24.519210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f35f-04f6-4b65-845b-568fdef022a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:24.519819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f35f-04f6-4b65-845b-568fdef022a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:24.520099 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f35f-04f6-4b65-845b-568fdef022a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:24.520415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f35f-04f6-4b65-845b-568fdef022a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:24.521081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f35f-04f6-4b65-845b-568fdef022a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:24.523369 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f35f-04f6-4b65-845b-568fdef022a6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:24.533661 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de97499284f94cb19c6b51bd2c308a90', 'request_id': 'req-a6e43e95-1f01-45f0-8366-f3eb1460f25d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:24.535554 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1314/2617] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:29:24.540408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de97499284f94cb19c6b51bd2c308a90', 'request_id': 'req-a6e43e95-1f01-45f0-8366-f3eb1460f25d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:24.544109 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f35f-04f6-4b65-845b-568fdef022a6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:24.547881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de97499284f94cb19c6b51bd2c308a90', 'request_id': 'req-a6e43e95-1f01-45f0-8366-f3eb1460f25d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:24.552155 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f35f-04f6-4b65-845b-568fdef022a6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:24.609332 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da481d-3ec7-4784-af8a-fa7159d101b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:24.609991 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da481d-3ec7-4784-af8a-fa7159d101b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:24.610276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da481d-3ec7-4784-af8a-fa7159d101b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:24.610556 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da481d-3ec7-4784-af8a-fa7159d101b8 admin admin] PATH_INFO: `/v3/projects/c035ec77267e4a369342ba1c00687dad/users/e51c307b8ca844009e40ab8d11d4a218/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:24.625845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da481d-3ec7-4784-af8a-fa7159d101b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c035ec77267e4a369342ba1c00687dad, user_id=e51c307b8ca844009e40ab8d11d4a218, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:24.628058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da481d-3ec7-4784-af8a-fa7159d101b8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:24.655698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] The token cache is being invalidate because project de97499284f94cb19c6b51bd2c308a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:24.655992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:24.656652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:24.658214 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1304/2618] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:24 2022] DELETE /identity/v3/projects/de97499284f94cb19c6b51bd2c308a90 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:24.662060 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:24.663628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:24.677313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43e95-1f01-45f0-8366-f3eb1460f25d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:24.682242 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:24.687243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:24.687243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:24.687243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] PATH_INFO: `/v3/users/c39426ab12a74d758a814a99911a74dc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:24.687243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39426ab12a74d758a814a99911a74dc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:24.687243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:24.743380 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1315/2619] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:24 2022] PUT /identity/v3/projects/c035ec77267e4a369342ba1c00687dad/users/e51c307b8ca844009e40ab8d11d4a218/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:24.747181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da481d-3ec7-4784-af8a-fa7159d101b8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:24.748939 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-57da481d-3ec7-4784-af8a-fa7159d101b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:24.753916 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:24.827666 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da481d-3ec7-4784-af8a-fa7159d101b8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:24.830172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419de450-eaa6-4e57-a621-63340d6ada8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:24.830790 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419de450-eaa6-4e57-a621-63340d6ada8f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:24.831070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419de450-eaa6-4e57-a621-63340d6ada8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:24.831344 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419de450-eaa6-4e57-a621-63340d6ada8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:24.831987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419de450-eaa6-4e57-a621-63340d6ada8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:24.833926 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419de450-eaa6-4e57-a621-63340d6ada8f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:24.845721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1316/2620] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:29:24.849994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419de450-eaa6-4e57-a621-63340d6ada8f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:24.862452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419de450-eaa6-4e57-a621-63340d6ada8f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:24.868166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6387d2-6f2a-43cf-9617-cc8c56fcf46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:24.869640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6387d2-6f2a-43cf-9617-cc8c56fcf46f admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:24.869640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6387d2-6f2a-43cf-9617-cc8c56fcf46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:24.869640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6387d2-6f2a-43cf-9617-cc8c56fcf46f admin admin] PATH_INFO: `/v3/projects/c035ec77267e4a369342ba1c00687dad/users/e51c307b8ca844009e40ab8d11d4a218/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:24.871747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6387d2-6f2a-43cf-9617-cc8c56fcf46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c035ec77267e4a369342ba1c00687dad, user_id=e51c307b8ca844009e40ab8d11d4a218, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:24.874577 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6387d2-6f2a-43cf-9617-cc8c56fcf46f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:24.886224 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1317/2621] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:24 2022] PUT /identity/v3/projects/c035ec77267e4a369342ba1c00687dad/users/e51c307b8ca844009e40ab8d11d4a218/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:24.898780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9b78-e860-4ed6-ab74-0487474798b2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:24.899262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9b78-e860-4ed6-ab74-0487474798b2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:24.899540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9b78-e860-4ed6-ab74-0487474798b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:24.923717 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39426ab12a74d758a814a99911a74dc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:24.934962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39426ab12a74d758a814a99911a74dc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:24.943135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-76df9b78-e860-4ed6-ab74-0487474798b2 None None] MFA Rules not processed for user `e51c307b8ca844009e40ab8d11d4a218`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:24.944564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-76df9b78-e860-4ed6-ab74-0487474798b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:25.022572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1318/2622] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:25.034751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df9b78-e860-4ed6-ab74-0487474798b2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:25.036664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-76df9b78-e860-4ed6-ab74-0487474798b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:25.052644 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39426ab12a74d758a814a99911a74dc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:25.053645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39426ab12a74d758a814a99911a74dc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:25.054376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39426ab12a74d758a814a99911a74dc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:25.075582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1305/2623] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:24 2022] DELETE /identity/v3/users/c39426ab12a74d758a814a99911a74dc => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:25.100118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df9b78-e860-4ed6-ab74-0487474798b2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:25.157590 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8afa88-cbb6-427b-a30c-0cd9dec50d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:25.158513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8afa88-cbb6-427b-a30c-0cd9dec50d1f service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:25.158891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8afa88-cbb6-427b-a30c-0cd9dec50d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:25.159919 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8afa88-cbb6-427b-a30c-0cd9dec50d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:25.161832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ad8afa88-cbb6-427b-a30c-0cd9dec50d1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:25.225946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8afa88-cbb6-427b-a30c-0cd9dec50d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:25.227393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8afa88-cbb6-427b-a30c-0cd9dec50d1f service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:25.242229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:25.245480 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1319/2624] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:29:25.665992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:25.667438 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:25.743510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:25.757350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05f93-0fc6-4938-8ddf-33ee28374862 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:25.762215 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:25.762775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:25.763053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:25.763329 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] PATH_INFO: `/v3/projects/f9e179a6492642d08fd0768f63196633` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:25.764495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e179a6492642d08fd0768f63196633)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:25.767407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:25.912546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e179a6492642d08fd0768f63196633', 'request_id': 'req-f582ac30-9100-4346-aa27-1495fc4ce461'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:25.930085 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e179a6492642d08fd0768f63196633', 'request_id': 'req-f582ac30-9100-4346-aa27-1495fc4ce461'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:25.937829 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e179a6492642d08fd0768f63196633', 'request_id': 'req-f582ac30-9100-4346-aa27-1495fc4ce461'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:26.025195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] The token cache is being invalidate because project f9e179a6492642d08fd0768f63196633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:26.027639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:26.027639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:26.028176 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1306/2625] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:25 2022] DELETE /identity/v3/projects/f9e179a6492642d08fd0768f63196633 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:26.032360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8afa88-cbb6-427b-a30c-0cd9dec50d1f service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:26.044599 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8afa88-cbb6-427b-a30c-0cd9dec50d1f service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:26.110675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:26.111235 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:26.111519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:26.111794 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] PATH_INFO: `/v3/users/d7f368190a3a40188c71ec2d3215e5c5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:26.112956 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f368190a3a40188c71ec2d3215e5c5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:26.114929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:26.349537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f368190a3a40188c71ec2d3215e5c5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:26.359979 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f368190a3a40188c71ec2d3215e5c5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:26.365642 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f368190a3a40188c71ec2d3215e5c5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:26.447610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f368190a3a40188c71ec2d3215e5c5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:26.462066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f368190a3a40188c71ec2d3215e5c5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:26.464574 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:26.469033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1320/2626] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:26 2022] DELETE /identity/v3/users/d7f368190a3a40188c71ec2d3215e5c5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:27.028423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:27.029920 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:27.052096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582ac30-9100-4346-aa27-1495fc4ce461 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:27.080559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:27.082040 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:27.137330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:27.137976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.138362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.138623 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] PATH_INFO: `/v3/projects/d39e250556384712b4eb8e1819d185f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:27.139808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39e250556384712b4eb8e1819d185f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:27.142010 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:27.168918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb46947-b24b-4c2d-884e-10b37d55768a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:27.173579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:27.180306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.180306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.180306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] PATH_INFO: `/v3/users/a51ee88d16004507aa9d199782ced8e5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:27.188763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51ee88d16004507aa9d199782ced8e5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:27.190715 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:27.299128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39e250556384712b4eb8e1819d185f2', 'request_id': 'req-06dc5b92-7e9b-4265-834e-358ba1afc8e8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:27.305283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39e250556384712b4eb8e1819d185f2', 'request_id': 'req-06dc5b92-7e9b-4265-834e-358ba1afc8e8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:27.310915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39e250556384712b4eb8e1819d185f2', 'request_id': 'req-06dc5b92-7e9b-4265-834e-358ba1afc8e8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:27.374025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] The token cache is being invalidate because project d39e250556384712b4eb8e1819d185f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:27.374244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:27.374863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06dc5b92-7e9b-4265-834e-358ba1afc8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:27.376368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1307/2627] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:27 2022] DELETE /identity/v3/projects/d39e250556384712b4eb8e1819d185f2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:27.382362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b63fd7-2b51-4e6b-a313-0d05047adb4d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.382641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b63fd7-2b51-4e6b-a313-0d05047adb4d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.382910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b63fd7-2b51-4e6b-a313-0d05047adb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:27.402955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-48b63fd7-2b51-4e6b-a313-0d05047adb4d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:27.404130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-48b63fd7-2b51-4e6b-a313-0d05047adb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:27.409296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:27.435290 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51ee88d16004507aa9d199782ced8e5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:27.443877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51ee88d16004507aa9d199782ced8e5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:27.443877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51ee88d16004507aa9d199782ced8e5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:27.469569 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1308/2628] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:27.477445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5b0b-bcce-448b-b63c-0b8ef61150a4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.478165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5b0b-bcce-448b-b63c-0b8ef61150a4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.478309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5b0b-bcce-448b-b63c-0b8ef61150a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:27.497964 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-519b5b0b-bcce-448b-b63c-0b8ef61150a4 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:27.499178 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-519b5b0b-bcce-448b-b63c-0b8ef61150a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:27.506802 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1309/2629] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:27.510857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b5b0b-bcce-448b-b63c-0b8ef61150a4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:27.519940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b5b0b-bcce-448b-b63c-0b8ef61150a4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:27.524701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccb4b2-ac4a-41dc-8b47-abdaed644ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:27.525255 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb4b2-ac4a-41dc-8b47-abdaed644ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.525529 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb4b2-ac4a-41dc-8b47-abdaed644ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.525801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb4b2-ac4a-41dc-8b47-abdaed644ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:27.526427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccb4b2-ac4a-41dc-8b47-abdaed644ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:29:27.526728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccb4b2-ac4a-41dc-8b47-abdaed644ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:27.528383 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccb4b2-ac4a-41dc-8b47-abdaed644ebe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:27.539368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1310/2630] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:29:27.546517 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccb4b2-ac4a-41dc-8b47-abdaed644ebe admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:27.555493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccb4b2-ac4a-41dc-8b47-abdaed644ebe admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:27.560556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4418f-b7d7-4529-b9c5-2e12798c8688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:27.561097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4418f-b7d7-4529-b9c5-2e12798c8688 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.561374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4418f-b7d7-4529-b9c5-2e12798c8688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.561655 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4418f-b7d7-4529-b9c5-2e12798c8688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:27.562269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4418f-b7d7-4529-b9c5-2e12798c8688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:27.563478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51ee88d16004507aa9d199782ced8e5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:27.564110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4418f-b7d7-4529-b9c5-2e12798c8688 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:27.577046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51ee88d16004507aa9d199782ced8e5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:27.582976 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1321/2631] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:27 2022] DELETE /identity/v3/users/a51ee88d16004507aa9d199782ced8e5 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:27.648750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1311/2632] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:27 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:27.653606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:27.655061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:27.725704 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee05d7-0df9-4193-b553-5c448ae3fc48 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:27.739178 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:27.784440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e76f7-f7aa-4014-a522-e9bd43f964f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:27.785042 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e76f7-f7aa-4014-a522-e9bd43f964f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.785324 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e76f7-f7aa-4014-a522-e9bd43f964f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.785596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e76f7-f7aa-4014-a522-e9bd43f964f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:27.786222 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e76f7-f7aa-4014-a522-e9bd43f964f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:27.788105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e76f7-f7aa-4014-a522-e9bd43f964f4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:27.872756 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4418f-b7d7-4529-b9c5-2e12798c8688 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:27.874776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ce4418f-b7d7-4529-b9c5-2e12798c8688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:27.895570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1322/2633] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:27 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:27.899567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e76f7-f7aa-4014-a522-e9bd43f964f4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:27.900260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4418f-b7d7-4529-b9c5-2e12798c8688 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:27.905028 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:27.905673 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.905956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.906233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] PATH_INFO: `/v3/projects/704d97630437484297e0aec818ce4316` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:27.911469 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e76f7-f7aa-4014-a522-e9bd43f964f4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:27.917124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aaecc-7f5f-48a0-82fb-9a2f326e2604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:27.918304 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aaecc-7f5f-48a0-82fb-9a2f326e2604 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.918541 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aaecc-7f5f-48a0-82fb-9a2f326e2604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.918957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aaecc-7f5f-48a0-82fb-9a2f326e2604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:27.919675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394aaecc-7f5f-48a0-82fb-9a2f326e2604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:27.921578 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394aaecc-7f5f-48a0-82fb-9a2f326e2604 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:27.921702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704d97630437484297e0aec818ce4316)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:27.923845 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:27.932796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1323/2634] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:29:27.937085 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aaecc-7f5f-48a0-82fb-9a2f326e2604 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:27.948015 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aaecc-7f5f-48a0-82fb-9a2f326e2604 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:27.954263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fbdd2-67e3-474d-8d69-0eec81271e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:27.955147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fbdd2-67e3-474d-8d69-0eec81271e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.955517 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fbdd2-67e3-474d-8d69-0eec81271e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.955689 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fbdd2-67e3-474d-8d69-0eec81271e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:27.956510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fbdd2-67e3-474d-8d69-0eec81271e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:27.958243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fbdd2-67e3-474d-8d69-0eec81271e7b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:27.972265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1324/2635] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:29:27.973144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fbdd2-67e3-474d-8d69-0eec81271e7b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:27.983181 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fbdd2-67e3-474d-8d69-0eec81271e7b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:27.987745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13944c-5a41-40cb-8398-fe141f449fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:27.992328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13944c-5a41-40cb-8398-fe141f449fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:27.992328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13944c-5a41-40cb-8398-fe141f449fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:27.992328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13944c-5a41-40cb-8398-fe141f449fbe admin admin] PATH_INFO: `/v3/projects/34d2c97e5b5543a09c35f55eb342dd3f/users/18dbef22f86a4a56ada3a86175d576e2/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.005663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13944c-5a41-40cb-8398-fe141f449fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d2c97e5b5543a09c35f55eb342dd3f, user_id=18dbef22f86a4a56ada3a86175d576e2, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:28.008378 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13944c-5a41-40cb-8398-fe141f449fbe admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:28.022578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704d97630437484297e0aec818ce4316', 'request_id': 'req-27ded42d-8375-4aca-98c2-6f9c84d58f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:28.029259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704d97630437484297e0aec818ce4316', 'request_id': 'req-27ded42d-8375-4aca-98c2-6f9c84d58f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:28.035096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704d97630437484297e0aec818ce4316', 'request_id': 'req-27ded42d-8375-4aca-98c2-6f9c84d58f37'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:28.071891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1325/2636] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:27 2022] PUT /identity/v3/projects/34d2c97e5b5543a09c35f55eb342dd3f/users/18dbef22f86a4a56ada3a86175d576e2/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:28.076823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d8230-dc48-4702-b855-0057cf1629da None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.077107 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d8230-dc48-4702-b855-0057cf1629da None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.077382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d8230-dc48-4702-b855-0057cf1629da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.089752 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] The token cache is being invalidate because project 704d97630437484297e0aec818ce4316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:28.090052 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:28.090688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-27ded42d-8375-4aca-98c2-6f9c84d58f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:28.092181 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1312/2637] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:27 2022] DELETE /identity/v3/projects/704d97630437484297e0aec818ce4316 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:28.096529 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a14d8230-dc48-4702-b855-0057cf1629da None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:28.097154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672e283-53f6-44e3-be7d-6efd996e5dd9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.097443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672e283-53f6-44e3-be7d-6efd996e5dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.097744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672e283-53f6-44e3-be7d-6efd996e5dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.097895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a14d8230-dc48-4702-b855-0057cf1629da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:28.118291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3672e283-53f6-44e3-be7d-6efd996e5dd9 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:28.119620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3672e283-53f6-44e3-be7d-6efd996e5dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:28.158360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1326/2638] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:28.160509 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:28.168614 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d8230-dc48-4702-b855-0057cf1629da None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:28.170074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a14d8230-dc48-4702-b855-0057cf1629da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:28.179979 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1313/2639] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:28.188130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb773c2c-6e1e-4987-8d51-fd0f238e3054 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.188599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb773c2c-6e1e-4987-8d51-fd0f238e3054 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.188961 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb773c2c-6e1e-4987-8d51-fd0f238e3054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.210254 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eb773c2c-6e1e-4987-8d51-fd0f238e3054 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:28.211467 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb773c2c-6e1e-4987-8d51-fd0f238e3054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:28.220104 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1314/2640] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:28.224250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb773c2c-6e1e-4987-8d51-fd0f238e3054 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:28.231536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d8230-dc48-4702-b855-0057cf1629da None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:28.233816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb773c2c-6e1e-4987-8d51-fd0f238e3054 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:28.235234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60909b-6ebd-461f-aeea-b0bdfabfd3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:28.235841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60909b-6ebd-461f-aeea-b0bdfabfd3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.236135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60909b-6ebd-461f-aeea-b0bdfabfd3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.236477 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60909b-6ebd-461f-aeea-b0bdfabfd3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.238620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650c4ad-9ed3-4ea0-95b7-62f7942c7f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:28.239209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650c4ad-9ed3-4ea0-95b7-62f7942c7f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.239494 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650c4ad-9ed3-4ea0-95b7-62f7942c7f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.239773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650c4ad-9ed3-4ea0-95b7-62f7942c7f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.240444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650c4ad-9ed3-4ea0-95b7-62f7942c7f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:29:28.246666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650c4ad-9ed3-4ea0-95b7-62f7942c7f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:28.246666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650c4ad-9ed3-4ea0-95b7-62f7942c7f5e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:28.246884 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60909b-6ebd-461f-aeea-b0bdfabfd3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:28.248155 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60909b-6ebd-461f-aeea-b0bdfabfd3b3 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:28.254293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1315/2641] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:29:28.257942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1327/2642] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:29:28.258682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650c4ad-9ed3-4ea0-95b7-62f7942c7f5e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:28.268387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650c4ad-9ed3-4ea0-95b7-62f7942c7f5e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:28.273496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0469be-4679-49a9-be4b-459ef71aaa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:28.274141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0469be-4679-49a9-be4b-459ef71aaa6d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.276777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0469be-4679-49a9-be4b-459ef71aaa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.276777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0469be-4679-49a9-be4b-459ef71aaa6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.276777 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0469be-4679-49a9-be4b-459ef71aaa6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:28.278062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0469be-4679-49a9-be4b-459ef71aaa6d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:28.394074 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1316/2643] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:28 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:28.398258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60909b-6ebd-461f-aeea-b0bdfabfd3b3 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:28.404123 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:28.409695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60909b-6ebd-461f-aeea-b0bdfabfd3b3 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:28.467100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45147-9a10-4b39-be6d-5a33fd5853fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:28.467821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45147-9a10-4b39-be6d-5a33fd5853fc admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.467982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45147-9a10-4b39-be6d-5a33fd5853fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.468288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45147-9a10-4b39-be6d-5a33fd5853fc admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.468936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d45147-9a10-4b39-be6d-5a33fd5853fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:28.470852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d45147-9a10-4b39-be6d-5a33fd5853fc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:28.546988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1328/2644] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:28 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:28.551082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0469be-4679-49a9-be4b-459ef71aaa6d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:28.561301 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0469be-4679-49a9-be4b-459ef71aaa6d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:28.566115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4f13-46b9-45aa-8da3-41e4fb0c774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:28.566716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4f13-46b9-45aa-8da3-41e4fb0c774d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.566993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4f13-46b9-45aa-8da3-41e4fb0c774d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.567262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4f13-46b9-45aa-8da3-41e4fb0c774d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.567930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d4f13-46b9-45aa-8da3-41e4fb0c774d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:28.569541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d4f13-46b9-45aa-8da3-41e4fb0c774d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:28.580137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1317/2645] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:28.584394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45147-9a10-4b39-be6d-5a33fd5853fc admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:28.595776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45147-9a10-4b39-be6d-5a33fd5853fc admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:28.600427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a77a0-c7ff-4c75-8fe4-23641df0079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:28.601041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a77a0-c7ff-4c75-8fe4-23641df0079a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.601321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a77a0-c7ff-4c75-8fe4-23641df0079a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.601597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a77a0-c7ff-4c75-8fe4-23641df0079a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.602301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a77a0-c7ff-4c75-8fe4-23641df0079a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:28.604451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a77a0-c7ff-4c75-8fe4-23641df0079a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:28.615320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1329/2646] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:28.619864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4f13-46b9-45aa-8da3-41e4fb0c774d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:28.630459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4f13-46b9-45aa-8da3-41e4fb0c774d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:28.635418 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081edda-846d-4ab9-9e8b-dae38166a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:28.636147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081edda-846d-4ab9-9e8b-dae38166a111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.637209 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081edda-846d-4ab9-9e8b-dae38166a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.637574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081edda-846d-4ab9-9e8b-dae38166a111 admin admin] PATH_INFO: `/v3/projects/fb20ad6344604afdadbca861197cc48f/users/6b549ccec3474cf0ade35a0d03a0e2ff/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.654091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081edda-846d-4ab9-9e8b-dae38166a111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb20ad6344604afdadbca861197cc48f, user_id=6b549ccec3474cf0ade35a0d03a0e2ff, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:28.656915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081edda-846d-4ab9-9e8b-dae38166a111 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:28.705594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a77a0-c7ff-4c75-8fe4-23641df0079a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:28.707376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-031a77a0-c7ff-4c75-8fe4-23641df0079a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:28.767425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a77a0-c7ff-4c75-8fe4-23641df0079a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:28.771259 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9630b89-e79e-4e65-880f-e361359f8203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:28.771871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9630b89-e79e-4e65-880f-e361359f8203 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.772152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9630b89-e79e-4e65-880f-e361359f8203 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.772460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9630b89-e79e-4e65-880f-e361359f8203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.775639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b9630b89-e79e-4e65-880f-e361359f8203 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:28.787017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1318/2647] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:28 2022] PUT /identity/v3/projects/fb20ad6344604afdadbca861197cc48f/users/6b549ccec3474cf0ade35a0d03a0e2ff/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:28.797313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b5a2-6ab6-4180-b88c-836b130b63e2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:28.797670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b5a2-6ab6-4180-b88c-836b130b63e2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:28.798020 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b5a2-6ab6-4180-b88c-836b130b63e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:28.826406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fe12b5a2-6ab6-4180-b88c-836b130b63e2 None None] MFA Rules not processed for user `6b549ccec3474cf0ade35a0d03a0e2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:28.827746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fe12b5a2-6ab6-4180-b88c-836b130b63e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:28.847190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9630b89-e79e-4e65-880f-e361359f8203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:28.849061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9630b89-e79e-4e65-880f-e361359f8203 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:28.870209 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1330/2648] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:29:28.907220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1319/2649] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:28.918421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9630b89-e79e-4e65-880f-e361359f8203 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:28.920490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b9630b89-e79e-4e65-880f-e361359f8203 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:28.956785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:28.997759 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9630b89-e79e-4e65-880f-e361359f8203 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:29.073195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe4909-8215-414a-9d28-164a952a4342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:29.073737 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe4909-8215-414a-9d28-164a952a4342 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:29.074782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe4909-8215-414a-9d28-164a952a4342 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:29.075061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe4909-8215-414a-9d28-164a952a4342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:29.085075 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe4909-8215-414a-9d28-164a952a4342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:29.089888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe4909-8215-414a-9d28-164a952a4342 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:29.097216 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1331/2650] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:33.626376 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b5a2-6ab6-4180-b88c-836b130b63e2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:33.725029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:33.730932 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b5a2-6ab6-4180-b88c-836b130b63e2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:33.743364 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:33.744030 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:33.744361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:33.744881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] PATH_INFO: `/v3/users/6b549ccec3474cf0ade35a0d03a0e2ff` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:33.746589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b549ccec3474cf0ade35a0d03a0e2ff)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:33.748726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:33.821621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd747c-fe5f-46c6-b12a-e09a2cce6dc7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:33.822146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd747c-fe5f-46c6-b12a-e09a2cce6dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:33.822146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd747c-fe5f-46c6-b12a-e09a2cce6dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:33.855586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8fdd747c-fe5f-46c6-b12a-e09a2cce6dc7 None None] MFA Rules not processed for user `18dbef22f86a4a56ada3a86175d576e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:33.861609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8fdd747c-fe5f-46c6-b12a-e09a2cce6dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:33.962510 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1332/2651] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:33.968764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd747c-fe5f-46c6-b12a-e09a2cce6dc7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:33.970823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8fdd747c-fe5f-46c6-b12a-e09a2cce6dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:33.985534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd747c-fe5f-46c6-b12a-e09a2cce6dc7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:33.990572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df250322-9bf1-4f75-be0f-e6d42d213316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:33.991425 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df250322-9bf1-4f75-be0f-e6d42d213316 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:33.992016 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df250322-9bf1-4f75-be0f-e6d42d213316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:33.992394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df250322-9bf1-4f75-be0f-e6d42d213316 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:33.993273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df250322-9bf1-4f75-be0f-e6d42d213316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:33.995258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df250322-9bf1-4f75-be0f-e6d42d213316 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:34.059825 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b549ccec3474cf0ade35a0d03a0e2ff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:34.069089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b549ccec3474cf0ade35a0d03a0e2ff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:34.085879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1333/2652] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:33 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:34.090881 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df250322-9bf1-4f75-be0f-e6d42d213316 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:34.120125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:34.164351 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df250322-9bf1-4f75-be0f-e6d42d213316 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:34.169654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ab9be-b2a8-4cfd-9c19-29c615910454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:34.170600 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ab9be-b2a8-4cfd-9c19-29c615910454 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:34.170975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ab9be-b2a8-4cfd-9c19-29c615910454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:34.171315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ab9be-b2a8-4cfd-9c19-29c615910454 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:34.172022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ab9be-b2a8-4cfd-9c19-29c615910454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:34.175575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ab9be-b2a8-4cfd-9c19-29c615910454 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:34.193256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b549ccec3474cf0ade35a0d03a0e2ff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:34.193907 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b549ccec3474cf0ade35a0d03a0e2ff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:34.194584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0ce62f7b-4e22-4c9a-895e-9719af08e028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b549ccec3474cf0ade35a0d03a0e2ff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:34.220271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1320/2653] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:33 2022] DELETE /identity/v3/users/6b549ccec3474cf0ade35a0d03a0e2ff => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:34.224527 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ecb4-d661-4f21-a57f-d7aaaf1da1a4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:34.225014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ecb4-d661-4f21-a57f-d7aaaf1da1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:34.225366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ecb4-d661-4f21-a57f-d7aaaf1da1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:34.245917 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8932ecb4-d661-4f21-a57f-d7aaaf1da1a4 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:34.247121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8932ecb4-d661-4f21-a57f-d7aaaf1da1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:34.268250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1334/2654] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:34 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:34.272533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ab9be-b2a8-4cfd-9c19-29c615910454 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:34.274623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b26ab9be-b2a8-4cfd-9c19-29c615910454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:34.288757 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ab9be-b2a8-4cfd-9c19-29c615910454 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:34.319582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1321/2655] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:29:34.330640 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932ecb4-d661-4f21-a57f-d7aaaf1da1a4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:34.332153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8932ecb4-d661-4f21-a57f-d7aaaf1da1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:34.352359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babf50-043a-42d9-928d-992c83977ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:34.352975 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babf50-043a-42d9-928d-992c83977ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:34.353583 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babf50-043a-42d9-928d-992c83977ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:34.353583 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babf50-043a-42d9-928d-992c83977ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:34.354210 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babf50-043a-42d9-928d-992c83977ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:34.356473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babf50-043a-42d9-928d-992c83977ab2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:34.367318 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1335/2656] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:29:34.371367 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babf50-043a-42d9-928d-992c83977ab2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:34.381957 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babf50-043a-42d9-928d-992c83977ab2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:34.389389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea3539-5453-4cd6-83e2-bc3aff79b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:34.390641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3539-5453-4cd6-83e2-bc3aff79b99c admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:34.391219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3539-5453-4cd6-83e2-bc3aff79b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:34.391625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3539-5453-4cd6-83e2-bc3aff79b99c admin admin] PATH_INFO: `/v3/projects/d127e53a12bc402cb808642e2b74dfbd/users/38a37160a31b4fe7ab14cec45c5efe3b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:34.400769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932ecb4-d661-4f21-a57f-d7aaaf1da1a4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:34.405045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae27e38-ce68-451d-9d4c-cfc71cb2d4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:34.405660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27e38-ce68-451d-9d4c-cfc71cb2d4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:34.405940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27e38-ce68-451d-9d4c-cfc71cb2d4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:34.406216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27e38-ce68-451d-9d4c-cfc71cb2d4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:34.407966 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea3539-5453-4cd6-83e2-bc3aff79b99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d127e53a12bc402cb808642e2b74dfbd, user_id=38a37160a31b4fe7ab14cec45c5efe3b, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:34.410806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea3539-5453-4cd6-83e2-bc3aff79b99c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:34.415933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae27e38-ce68-451d-9d4c-cfc71cb2d4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:34.417993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae27e38-ce68-451d-9d4c-cfc71cb2d4c4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:34.427737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1322/2657] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:29:34.498987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1336/2658] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:34 2022] PUT /identity/v3/projects/d127e53a12bc402cb808642e2b74dfbd/users/38a37160a31b4fe7ab14cec45c5efe3b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:34.500412 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae27e38-ce68-451d-9d4c-cfc71cb2d4c4 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:34.510497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae27e38-ce68-451d-9d4c-cfc71cb2d4c4 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:34.529685 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:34.571362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdd243-4160-42c8-816e-f42203025b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:34.571905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdd243-4160-42c8-816e-f42203025b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:34.572184 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdd243-4160-42c8-816e-f42203025b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:34.572497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdd243-4160-42c8-816e-f42203025b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:34.573152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdd243-4160-42c8-816e-f42203025b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:34.575285 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdd243-4160-42c8-816e-f42203025b04 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:34.585967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1323/2659] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:29:34.590901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea3539-5453-4cd6-83e2-bc3aff79b99c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:34.601373 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea3539-5453-4cd6-83e2-bc3aff79b99c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:34.606236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbeae8-6971-4435-b9fd-a03e0b88646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:34.606911 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbeae8-6971-4435-b9fd-a03e0b88646c admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:34.607188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbeae8-6971-4435-b9fd-a03e0b88646c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:34.607466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbeae8-6971-4435-b9fd-a03e0b88646c admin admin] PATH_INFO: `/v3/projects/d127e53a12bc402cb808642e2b74dfbd/users/38a37160a31b4fe7ab14cec45c5efe3b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:34.609462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbeae8-6971-4435-b9fd-a03e0b88646c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d127e53a12bc402cb808642e2b74dfbd, user_id=38a37160a31b4fe7ab14cec45c5efe3b, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:34.612080 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbeae8-6971-4435-b9fd-a03e0b88646c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:34.625274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1337/2660] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:34 2022] PUT /identity/v3/projects/d127e53a12bc402cb808642e2b74dfbd/users/38a37160a31b4fe7ab14cec45c5efe3b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:35.181299 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdd243-4160-42c8-816e-f42203025b04 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:35.183853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2acdd243-4160-42c8-816e-f42203025b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:35.199183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdd243-4160-42c8-816e-f42203025b04 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:35.257420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:35.258047 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:35.258320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:35.258589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] PATH_INFO: `/v3/projects/fb20ad6344604afdadbca861197cc48f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:35.259711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb20ad6344604afdadbca861197cc48f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:35.262222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:35.421886 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb20ad6344604afdadbca861197cc48f', 'request_id': 'req-335b42b1-a42d-4e40-a1db-1b5ffd497af3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:35.432536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb20ad6344604afdadbca861197cc48f', 'request_id': 'req-335b42b1-a42d-4e40-a1db-1b5ffd497af3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:35.441784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb20ad6344604afdadbca861197cc48f', 'request_id': 'req-335b42b1-a42d-4e40-a1db-1b5ffd497af3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:35.530070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] The token cache is being invalidate because project fb20ad6344604afdadbca861197cc48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:35.532430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:35.532430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-335b42b1-a42d-4e40-a1db-1b5ffd497af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:35.533211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1324/2661] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:35 2022] DELETE /identity/v3/projects/fb20ad6344604afdadbca861197cc48f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:35.538147 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ccd47-0583-4d13-8acd-4beb3a42c231 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:35.538623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ccd47-0583-4d13-8acd-4beb3a42c231 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:35.538733 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ccd47-0583-4d13-8acd-4beb3a42c231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:35.560296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a73ccd47-0583-4d13-8acd-4beb3a42c231 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:35.561745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a73ccd47-0583-4d13-8acd-4beb3a42c231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:35.626198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1338/2662] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:35.636132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051cfef-f631-47ac-b9f9-2ec80447e171 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:35.636411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051cfef-f631-47ac-b9f9-2ec80447e171 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:35.637145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051cfef-f631-47ac-b9f9-2ec80447e171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:35.657407 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6051cfef-f631-47ac-b9f9-2ec80447e171 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:35.658542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6051cfef-f631-47ac-b9f9-2ec80447e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:35.666515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1325/2663] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:35.671464 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ccd47-0583-4d13-8acd-4beb3a42c231 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:35.681675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ccd47-0583-4d13-8acd-4beb3a42c231 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:35.691095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe40de2-800b-46ac-b651-7d1ac8621b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:35.691760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe40de2-800b-46ac-b651-7d1ac8621b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:35.692633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe40de2-800b-46ac-b651-7d1ac8621b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:35.692633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe40de2-800b-46ac-b651-7d1ac8621b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:35.693478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe40de2-800b-46ac-b651-7d1ac8621b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:29:35.694013 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe40de2-800b-46ac-b651-7d1ac8621b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:35.695841 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe40de2-800b-46ac-b651-7d1ac8621b79 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:35.703474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:35.713062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1339/2664] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:29:35.715472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051cfef-f631-47ac-b9f9-2ec80447e171 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:35.726866 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051cfef-f631-47ac-b9f9-2ec80447e171 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:35.733816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41f541-6177-4bb8-8db7-e52c0fde66f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:35.734639 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41f541-6177-4bb8-8db7-e52c0fde66f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:35.734919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41f541-6177-4bb8-8db7-e52c0fde66f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:35.735707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41f541-6177-4bb8-8db7-e52c0fde66f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:35.735872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41f541-6177-4bb8-8db7-e52c0fde66f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:35.737737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41f541-6177-4bb8-8db7-e52c0fde66f2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:35.854600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1326/2665] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:35 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:35.859349 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe40de2-800b-46ac-b651-7d1ac8621b79 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:35.870062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe40de2-800b-46ac-b651-7d1ac8621b79 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:35.930816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44a6dd-43ee-49a4-b293-b04173960578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:35.931431 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44a6dd-43ee-49a4-b293-b04173960578 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:35.931709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44a6dd-43ee-49a4-b293-b04173960578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:35.931981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44a6dd-43ee-49a4-b293-b04173960578 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:35.932684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44a6dd-43ee-49a4-b293-b04173960578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:35.935289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44a6dd-43ee-49a4-b293-b04173960578 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:36.062454 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41f541-6177-4bb8-8db7-e52c0fde66f2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:36.068194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1340/2666] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:35 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:36.074236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41f541-6177-4bb8-8db7-e52c0fde66f2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:36.079372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76264d43-1153-4399-a713-7bb872b64255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:36.080976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76264d43-1153-4399-a713-7bb872b64255 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:36.080976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76264d43-1153-4399-a713-7bb872b64255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:36.080976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76264d43-1153-4399-a713-7bb872b64255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:36.081450 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76264d43-1153-4399-a713-7bb872b64255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:36.083094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76264d43-1153-4399-a713-7bb872b64255 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:36.095162 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1327/2667] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:36.099845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44a6dd-43ee-49a4-b293-b04173960578 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:36.111166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44a6dd-43ee-49a4-b293-b04173960578 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:36.116287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44da01-9572-4206-abed-1738e70377d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:36.117126 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44da01-9572-4206-abed-1738e70377d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:36.117767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44da01-9572-4206-abed-1738e70377d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:36.117767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44da01-9572-4206-abed-1738e70377d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:36.118324 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44da01-9572-4206-abed-1738e70377d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:36.119923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44da01-9572-4206-abed-1738e70377d2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:36.132746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1341/2668] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:29:36.137409 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76264d43-1153-4399-a713-7bb872b64255 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:36.156170 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76264d43-1153-4399-a713-7bb872b64255 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:36.169666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b0ab-3220-4222-aaae-f141506cd66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:36.170489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b0ab-3220-4222-aaae-f141506cd66b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:36.170977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b0ab-3220-4222-aaae-f141506cd66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:36.171201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b0ab-3220-4222-aaae-f141506cd66b admin admin] PATH_INFO: `/v3/projects/87a4c37bbd8a4743905a38f6216a8d3e/users/3536970a18b343c6a90a6fdfe8c2463d/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:36.177500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:36.192286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b0ab-3220-4222-aaae-f141506cd66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a4c37bbd8a4743905a38f6216a8d3e, user_id=3536970a18b343c6a90a6fdfe8c2463d, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:36.196651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b0ab-3220-4222-aaae-f141506cd66b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:36.267936 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1328/2669] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:36 2022] PUT /identity/v3/projects/87a4c37bbd8a4743905a38f6216a8d3e/users/3536970a18b343c6a90a6fdfe8c2463d/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:36.279567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07a41a-b564-420a-8edc-8c4a9584cf86 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:36.279852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07a41a-b564-420a-8edc-8c4a9584cf86 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:36.280125 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07a41a-b564-420a-8edc-8c4a9584cf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:36.323287 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-be07a41a-b564-420a-8edc-8c4a9584cf86 None None] MFA Rules not processed for user `3536970a18b343c6a90a6fdfe8c2463d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:36.327518 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-be07a41a-b564-420a-8edc-8c4a9584cf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:36.435000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1342/2670] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:36.439956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b0ab-3220-4222-aaae-f141506cd66b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:36.507853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b0ab-3220-4222-aaae-f141506cd66b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:36.513272 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ca8fb-cd40-46b7-b31b-25284260f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:36.513883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca8fb-cd40-46b7-b31b-25284260f423 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:36.514160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca8fb-cd40-46b7-b31b-25284260f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:36.514431 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca8fb-cd40-46b7-b31b-25284260f423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:36.515062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ca8fb-cd40-46b7-b31b-25284260f423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:36.517144 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ca8fb-cd40-46b7-b31b-25284260f423 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:36.657427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1329/2671] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:36 2022] POST /identity/v3/projects => generated 371 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:36.661392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07a41a-b564-420a-8edc-8c4a9584cf86 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:36.691694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07a41a-b564-420a-8edc-8c4a9584cf86 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:36.760709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af587f-d758-4028-88da-1119109f67ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:36.761184 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af587f-d758-4028-88da-1119109f67ef admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:36.761468 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af587f-d758-4028-88da-1119109f67ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:36.761750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af587f-d758-4028-88da-1119109f67ef admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:36.762433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af587f-d758-4028-88da-1119109f67ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:36.764512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af587f-d758-4028-88da-1119109f67ef admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:36.776519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:36.934236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1343/2672] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:36 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:36.938307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ca8fb-cd40-46b7-b31b-25284260f423 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:36.949952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ca8fb-cd40-46b7-b31b-25284260f423 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:36.955545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e8e3a-2053-41fc-b628-8a27dcba37c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:36.958436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e8e3a-2053-41fc-b628-8a27dcba37c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:36.958436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e8e3a-2053-41fc-b628-8a27dcba37c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:36.958436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e8e3a-2053-41fc-b628-8a27dcba37c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:36.958436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e8e3a-2053-41fc-b628-8a27dcba37c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:36.958807 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e8e3a-2053-41fc-b628-8a27dcba37c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:36.970764 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1330/2673] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:36.974764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af587f-d758-4028-88da-1119109f67ef admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:36.986253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af587f-d758-4028-88da-1119109f67ef admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:36.991256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce8c60-f380-4398-8b0e-28bb7393c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:36.992317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce8c60-f380-4398-8b0e-28bb7393c143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:36.992677 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce8c60-f380-4398-8b0e-28bb7393c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:36.993016 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce8c60-f380-4398-8b0e-28bb7393c143 admin admin] PATH_INFO: `/v3/projects/772c1ab6f184417e925ee245bf212c69/users/3ef369de68f643a59a61204a6d3c1e6b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:37.011509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce8c60-f380-4398-8b0e-28bb7393c143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772c1ab6f184417e925ee245bf212c69, user_id=3ef369de68f643a59a61204a6d3c1e6b, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:37.012144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce8c60-f380-4398-8b0e-28bb7393c143 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:37.106923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1344/2674] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:36 2022] PUT /identity/v3/projects/772c1ab6f184417e925ee245bf212c69/users/3ef369de68f643a59a61204a6d3c1e6b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:37.111223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e8e3a-2053-41fc-b628-8a27dcba37c5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:37.121755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e8e3a-2053-41fc-b628-8a27dcba37c5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:37.194670 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f98957-c8d6-4417-9c84-d9c57f481f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:37.195336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f98957-c8d6-4417-9c84-d9c57f481f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:37.195469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f98957-c8d6-4417-9c84-d9c57f481f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:37.196761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f98957-c8d6-4417-9c84-d9c57f481f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:37.197804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f98957-c8d6-4417-9c84-d9c57f481f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:37.201368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f98957-c8d6-4417-9c84-d9c57f481f95 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:37.235564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce8c60-f380-4398-8b0e-28bb7393c143 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:37.250278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1331/2675] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:37.262456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce8c60-f380-4398-8b0e-28bb7393c143 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:37.274844 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec159b7-672b-4b5d-aa35-79c3877a195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:37.277391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec159b7-672b-4b5d-aa35-79c3877a195c admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:37.277787 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec159b7-672b-4b5d-aa35-79c3877a195c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:37.278026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec159b7-672b-4b5d-aa35-79c3877a195c admin admin] PATH_INFO: `/v3/projects/772c1ab6f184417e925ee245bf212c69/users/3ef369de68f643a59a61204a6d3c1e6b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:37.280730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec159b7-672b-4b5d-aa35-79c3877a195c admin admin] RBAC: Authorizing `identity:create_grant(project_id=772c1ab6f184417e925ee245bf212c69, user_id=3ef369de68f643a59a61204a6d3c1e6b, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:37.284688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec159b7-672b-4b5d-aa35-79c3877a195c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:37.301173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1345/2676] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:37 2022] PUT /identity/v3/projects/772c1ab6f184417e925ee245bf212c69/users/3ef369de68f643a59a61204a6d3c1e6b/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:37.314447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d8d40-ad7b-4900-9c54-aedfe8b74edf None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:37.315102 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d8d40-ad7b-4900-9c54-aedfe8b74edf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:37.315604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d8d40-ad7b-4900-9c54-aedfe8b74edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:37.358514 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ef1d8d40-ad7b-4900-9c54-aedfe8b74edf None None] MFA Rules not processed for user `3ef369de68f643a59a61204a6d3c1e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:37.360865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ef1d8d40-ad7b-4900-9c54-aedfe8b74edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:37.411057 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:37.440996 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1332/2677] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:37.457301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec159b7-672b-4b5d-aa35-79c3877a195c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:37.459074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2ec159b7-672b-4b5d-aa35-79c3877a195c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:37.555338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec159b7-672b-4b5d-aa35-79c3877a195c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:37.560698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0203be2-d8ad-43da-bdaf-25d749560955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:37.561505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0203be2-d8ad-43da-bdaf-25d749560955 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:37.561848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0203be2-d8ad-43da-bdaf-25d749560955 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:37.562376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0203be2-d8ad-43da-bdaf-25d749560955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:37.581433 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0203be2-d8ad-43da-bdaf-25d749560955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:37.584051 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0203be2-d8ad-43da-bdaf-25d749560955 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:37.608445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1346/2678] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:37.837207 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d8d40-ad7b-4900-9c54-aedfe8b74edf None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:37.853332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d8d40-ad7b-4900-9c54-aedfe8b74edf None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:37.866492 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e4bbb-3bf1-49b4-94a9-0a7c84a4d63c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:37.869218 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e4bbb-3bf1-49b4-94a9-0a7c84a4d63c service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:37.870969 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e4bbb-3bf1-49b4-94a9-0a7c84a4d63c service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:37.889485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e4bbb-3bf1-49b4-94a9-0a7c84a4d63c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:38.012977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e4bbb-3bf1-49b4-94a9-0a7c84a4d63c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:38.014919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e4bbb-3bf1-49b4-94a9-0a7c84a4d63c service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:38.028533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1333/2679] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:40.840969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6c696-ea1b-4991-9879-4687e63e230f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:40.840969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6c696-ea1b-4991-9879-4687e63e230f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:40.840969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6c696-ea1b-4991-9879-4687e63e230f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:40.875898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-97d6c696-ea1b-4991-9879-4687e63e230f None None] MFA Rules not processed for user `38a37160a31b4fe7ab14cec45c5efe3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:40.877127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-97d6c696-ea1b-4991-9879-4687e63e230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:40.944883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1347/2680] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:40.958099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e4bbb-3bf1-49b4-94a9-0a7c84a4d63c service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:40.959488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-404e4bbb-3bf1-49b4-94a9-0a7c84a4d63c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:41.042927 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e4bbb-3bf1-49b4-94a9-0a7c84a4d63c service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:41.046637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372eed2-21c7-423f-896e-40a31d9e019e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b84587baf0432c800a6278d7095cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:41.047238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372eed2-21c7-423f-896e-40a31d9e019e service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:41.047515 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372eed2-21c7-423f-896e-40a31d9e019e service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:41.047788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372eed2-21c7-423f-896e-40a31d9e019e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:41.049538 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f372eed2-21c7-423f-896e-40a31d9e019e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:41.116326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372eed2-21c7-423f-896e-40a31d9e019e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:41.118069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372eed2-21c7-423f-896e-40a31d9e019e service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:41.128582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1334/2681] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:41.485097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f97727-a9cb-41c1-811d-541cab62d476 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:41.485500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f97727-a9cb-41c1-811d-541cab62d476 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:41.485782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f97727-a9cb-41c1-811d-541cab62d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:41.546034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-28f97727-a9cb-41c1-811d-541cab62d476 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:41.547395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-28f97727-a9cb-41c1-811d-541cab62d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:41.565359 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:41.619845 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1348/2682] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:41.797990 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372eed2-21c7-423f-896e-40a31d9e019e service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:41.799599 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f372eed2-21c7-423f-896e-40a31d9e019e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:41.819283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:41.937956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372eed2-21c7-423f-896e-40a31d9e019e service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:41.943951 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14861116-4771-4b62-b82c-1687f839c2e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:41.944428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14861116-4771-4b62-b82c-1687f839c2e8 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:41.944688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14861116-4771-4b62-b82c-1687f839c2e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:41.944953 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14861116-4771-4b62-b82c-1687f839c2e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:41.955682 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14861116-4771-4b62-b82c-1687f839c2e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:41.957658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14861116-4771-4b62-b82c-1687f839c2e8 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:41.967236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1335/2683] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:29:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:29:45.913059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f97727-a9cb-41c1-811d-541cab62d476 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:45.916183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-28f97727-a9cb-41c1-811d-541cab62d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:46.029279 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f97727-a9cb-41c1-811d-541cab62d476 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:46.034559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:46.035602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:46.035960 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:46.036268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] PATH_INFO: `/v3/users/5c2623878dd44ed084272c593ae5dedb` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:46.040557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2623878dd44ed084272c593ae5dedb)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:46.043029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:46.280298 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2623878dd44ed084272c593ae5dedb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:46.287997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2623878dd44ed084272c593ae5dedb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:46.295043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2623878dd44ed084272c593ae5dedb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:46.386498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2623878dd44ed084272c593ae5dedb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:46.414203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2623878dd44ed084272c593ae5dedb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:46.438176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1349/2684] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:45 2022] DELETE /identity/v3/users/5c2623878dd44ed084272c593ae5dedb => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:46.442406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52814152-1a25-421f-be7a-7da56b240ffd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:46.442896 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52814152-1a25-421f-be7a-7da56b240ffd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:46.443014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52814152-1a25-421f-be7a-7da56b240ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:46.467677 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-52814152-1a25-421f-be7a-7da56b240ffd None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:46.468955 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52814152-1a25-421f-be7a-7da56b240ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:46.567231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1336/2685] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:46.577776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:46.594223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:46.651582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:46.672954 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f58c41-640d-4e99-bbd5-59af7ad17d49 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:46.676785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ebed3-d62c-4628-b31f-058f35f255e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:46.677514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ebed3-d62c-4628-b31f-058f35f255e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:46.677891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ebed3-d62c-4628-b31f-058f35f255e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:46.678261 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ebed3-d62c-4628-b31f-058f35f255e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:46.697962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ebed3-d62c-4628-b31f-058f35f255e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:46.697962 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ebed3-d62c-4628-b31f-058f35f255e0 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:46.709846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1350/2686] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:47.177758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52814152-1a25-421f-be7a-7da56b240ffd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:47.179489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52814152-1a25-421f-be7a-7da56b240ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:47.193343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52814152-1a25-421f-be7a-7da56b240ffd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:47.209286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:47.209286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:47.209286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:47.209286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] PATH_INFO: `/v3/projects/da94130fbd12425e9e0b7ef4617d1f99` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:47.209823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da94130fbd12425e9e0b7ef4617d1f99)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:47.211240 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:47.389147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da94130fbd12425e9e0b7ef4617d1f99', 'request_id': 'req-b8017f68-57d8-4be1-8a46-d18385106d03'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:47.395871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da94130fbd12425e9e0b7ef4617d1f99', 'request_id': 'req-b8017f68-57d8-4be1-8a46-d18385106d03'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:47.403769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da94130fbd12425e9e0b7ef4617d1f99', 'request_id': 'req-b8017f68-57d8-4be1-8a46-d18385106d03'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:47.490089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] The token cache is being invalidate because project da94130fbd12425e9e0b7ef4617d1f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:47.490749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:47.490950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:47.493025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1337/2687] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:47 2022] DELETE /identity/v3/projects/da94130fbd12425e9e0b7ef4617d1f99 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:47.498358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ebed3-d62c-4628-b31f-058f35f255e0 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:47.509790 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ebed3-d62c-4628-b31f-058f35f255e0 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:47.578286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:47.579223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:47.579717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:47.579995 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] PATH_INFO: `/v3/users/e51c307b8ca844009e40ab8d11d4a218` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:47.581154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51c307b8ca844009e40ab8d11d4a218)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:47.583073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:47.785780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51c307b8ca844009e40ab8d11d4a218'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:47.793544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51c307b8ca844009e40ab8d11d4a218'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:47.794223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51c307b8ca844009e40ab8d11d4a218'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:47.872810 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51c307b8ca844009e40ab8d11d4a218'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:47.887564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f2b19b33-20e4-4252-98df-c59d4c900e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51c307b8ca844009e40ab8d11d4a218'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:47.897364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1351/2688] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:29:47 2022] DELETE /identity/v3/users/e51c307b8ca844009e40ab8d11d4a218 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:48.462530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:48.465380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:48.481555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:48.488836 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8017f68-57d8-4be1-8a46-d18385106d03 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:48.555871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:48.556571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:48.556723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:48.557003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] PATH_INFO: `/v3/projects/c035ec77267e4a369342ba1c00687dad` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:48.558166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c035ec77267e4a369342ba1c00687dad)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:48.560134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:48.889183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c035ec77267e4a369342ba1c00687dad', 'request_id': 'req-26a86835-be8f-4663-a570-290f64d94ebb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:48.895628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c035ec77267e4a369342ba1c00687dad', 'request_id': 'req-26a86835-be8f-4663-a570-290f64d94ebb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:48.901098 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c035ec77267e4a369342ba1c00687dad', 'request_id': 'req-26a86835-be8f-4663-a570-290f64d94ebb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:49.032723 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] The token cache is being invalidate because project c035ec77267e4a369342ba1c00687dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:29:49.033310 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:49.034294 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-26a86835-be8f-4663-a570-290f64d94ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:29:49.036035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1338/2689] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:29:48 2022] DELETE /identity/v3/projects/c035ec77267e4a369342ba1c00687dad => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:49.041112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650baa-53f0-455e-a412-e5c21db620fe None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:49.041718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650baa-53f0-455e-a412-e5c21db620fe None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:49.041718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650baa-53f0-455e-a412-e5c21db620fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:49.063023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-12650baa-53f0-455e-a412-e5c21db620fe None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:49.064403 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-12650baa-53f0-455e-a412-e5c21db620fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:49.128472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:49.147920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1352/2690] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:49.149813 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f19bca-47c9-4779-8221-d3eaf20003c3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:49.150424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f19bca-47c9-4779-8221-d3eaf20003c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:49.150881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f19bca-47c9-4779-8221-d3eaf20003c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:49.172871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-55f19bca-47c9-4779-8221-d3eaf20003c3 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:49.174259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-55f19bca-47c9-4779-8221-d3eaf20003c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:49.183414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1339/2691] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:49.187863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12650baa-53f0-455e-a412-e5c21db620fe None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:49.198048 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12650baa-53f0-455e-a412-e5c21db620fe None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:49.203414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d51725-69f7-4993-9dbd-3ce793f6f760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:49.206427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51725-69f7-4993-9dbd-3ce793f6f760 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:49.206427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51725-69f7-4993-9dbd-3ce793f6f760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:49.206427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d51725-69f7-4993-9dbd-3ce793f6f760 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:49.206427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d51725-69f7-4993-9dbd-3ce793f6f760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:29:49.206427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d51725-69f7-4993-9dbd-3ce793f6f760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:49.207559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d51725-69f7-4993-9dbd-3ce793f6f760 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:49.219918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1353/2692] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:29:49.224541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f19bca-47c9-4779-8221-d3eaf20003c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:49.234870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f19bca-47c9-4779-8221-d3eaf20003c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:49.245763 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e9ed6-48a8-4f5b-a659-362358073ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:49.246417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9ed6-48a8-4f5b-a659-362358073ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:49.246701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9ed6-48a8-4f5b-a659-362358073ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:49.246976 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9ed6-48a8-4f5b-a659-362358073ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:49.247634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e9ed6-48a8-4f5b-a659-362358073ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:49.249566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e9ed6-48a8-4f5b-a659-362358073ef7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:49.359930 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1340/2693] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:49 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:49.361127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d51725-69f7-4993-9dbd-3ce793f6f760 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:49.374514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d51725-69f7-4993-9dbd-3ce793f6f760 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:49.439586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b083fa-f746-4712-b378-57357b8360df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:49.440140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b083fa-f746-4712-b378-57357b8360df admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:49.440455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b083fa-f746-4712-b378-57357b8360df admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:49.440734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b083fa-f746-4712-b378-57357b8360df admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:49.441366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b083fa-f746-4712-b378-57357b8360df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:49.443674 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b083fa-f746-4712-b378-57357b8360df admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:49.544846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1354/2694] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:49 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:49.546096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e9ed6-48a8-4f5b-a659-362358073ef7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:49.563025 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e9ed6-48a8-4f5b-a659-362358073ef7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:49.574940 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0a5d6-fe43-43d2-96a4-d9731ea667b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:49.576003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0a5d6-fe43-43d2-96a4-d9731ea667b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:49.576443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0a5d6-fe43-43d2-96a4-d9731ea667b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:49.576819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0a5d6-fe43-43d2-96a4-d9731ea667b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:49.577663 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0a5d6-fe43-43d2-96a4-d9731ea667b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:49.579897 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0a5d6-fe43-43d2-96a4-d9731ea667b8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:49.594146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1341/2695] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:49.598255 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b083fa-f746-4712-b378-57357b8360df admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:49.618186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b083fa-f746-4712-b378-57357b8360df admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:49.625382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52fddf-68f6-46cc-accb-c1442eedba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:49.626560 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52fddf-68f6-46cc-accb-c1442eedba9e admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:49.627153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52fddf-68f6-46cc-accb-c1442eedba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:49.627659 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52fddf-68f6-46cc-accb-c1442eedba9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:49.628579 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52fddf-68f6-46cc-accb-c1442eedba9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:49.630421 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52fddf-68f6-46cc-accb-c1442eedba9e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:49.660286 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1355/2696] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:29:49.664606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0a5d6-fe43-43d2-96a4-d9731ea667b8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:49.697885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0a5d6-fe43-43d2-96a4-d9731ea667b8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:49.704433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e405ea-12bd-4de8-9e04-443c8aa7e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:49.705334 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e405ea-12bd-4de8-9e04-443c8aa7e276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:49.705782 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e405ea-12bd-4de8-9e04-443c8aa7e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:49.706344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e405ea-12bd-4de8-9e04-443c8aa7e276 admin admin] PATH_INFO: `/v3/projects/5b2b03e439f34976b02a25fb4f910832/users/a6f6f7e0997d405cadebf8a3796cfc7f/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:49.725332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e405ea-12bd-4de8-9e04-443c8aa7e276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2b03e439f34976b02a25fb4f910832, user_id=a6f6f7e0997d405cadebf8a3796cfc7f, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:49.728440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e405ea-12bd-4de8-9e04-443c8aa7e276 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:49.802169 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1342/2697] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:49 2022] PUT /identity/v3/projects/5b2b03e439f34976b02a25fb4f910832/users/a6f6f7e0997d405cadebf8a3796cfc7f/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:49.815707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a31ddf-9fcc-4533-90f2-e30a06cf100f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:49.816192 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a31ddf-9fcc-4533-90f2-e30a06cf100f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:49.816675 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a31ddf-9fcc-4533-90f2-e30a06cf100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:49.849457 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-47a31ddf-9fcc-4533-90f2-e30a06cf100f None None] MFA Rules not processed for user `a6f6f7e0997d405cadebf8a3796cfc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:49.850889 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-47a31ddf-9fcc-4533-90f2-e30a06cf100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:49.936771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1356/2698] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:49.941487 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e405ea-12bd-4de8-9e04-443c8aa7e276 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:49.980571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:50.021975 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e405ea-12bd-4de8-9e04-443c8aa7e276 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:50.030604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddf736-2c5c-40a2-b411-7ffea1c7beb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:50.035158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf736-2c5c-40a2-b411-7ffea1c7beb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:50.035158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf736-2c5c-40a2-b411-7ffea1c7beb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:50.035158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf736-2c5c-40a2-b411-7ffea1c7beb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:50.035158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddf736-2c5c-40a2-b411-7ffea1c7beb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:50.035158 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddf736-2c5c-40a2-b411-7ffea1c7beb0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:50.148415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1343/2699] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:49 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:50.153154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a31ddf-9fcc-4533-90f2-e30a06cf100f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:50.167409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a31ddf-9fcc-4533-90f2-e30a06cf100f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:50.227711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:50.241253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453406db-2d83-4cb2-a463-8c5337e8e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:50.241253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453406db-2d83-4cb2-a463-8c5337e8e13f admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:50.241253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453406db-2d83-4cb2-a463-8c5337e8e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:50.241253 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453406db-2d83-4cb2-a463-8c5337e8e13f admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:50.241985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453406db-2d83-4cb2-a463-8c5337e8e13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:50.243115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453406db-2d83-4cb2-a463-8c5337e8e13f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:50.395254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1357/2700] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:50 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:50.396803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddf736-2c5c-40a2-b411-7ffea1c7beb0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:50.408877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddf736-2c5c-40a2-b411-7ffea1c7beb0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:50.414200 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa4060-174d-4795-8df3-5e667d29bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:50.414875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa4060-174d-4795-8df3-5e667d29bee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:50.415350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa4060-174d-4795-8df3-5e667d29bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:50.415680 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa4060-174d-4795-8df3-5e667d29bee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:50.416462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa4060-174d-4795-8df3-5e667d29bee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:50.418273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa4060-174d-4795-8df3-5e667d29bee9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:50.432278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1344/2701] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:50.437928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453406db-2d83-4cb2-a463-8c5337e8e13f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:50.450766 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453406db-2d83-4cb2-a463-8c5337e8e13f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:50.456005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ecd22-b9f6-4e80-bcd3-1660ee1fd5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:50.456657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ecd22-b9f6-4e80-bcd3-1660ee1fd5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:50.456936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ecd22-b9f6-4e80-bcd3-1660ee1fd5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:50.457208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ecd22-b9f6-4e80-bcd3-1660ee1fd5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:50.457859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ecd22-b9f6-4e80-bcd3-1660ee1fd5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:50.459471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ecd22-b9f6-4e80-bcd3-1660ee1fd5aa admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:50.472918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1358/2702] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:50.477196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa4060-174d-4795-8df3-5e667d29bee9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:50.489804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa4060-174d-4795-8df3-5e667d29bee9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:50.498056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f2496-03e2-4349-88dd-1da2b50aebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:50.498056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f2496-03e2-4349-88dd-1da2b50aebb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:50.498056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f2496-03e2-4349-88dd-1da2b50aebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:50.498056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f2496-03e2-4349-88dd-1da2b50aebb0 admin admin] PATH_INFO: `/v3/projects/8b7b8785660045d19d4ea3a84d05d214/users/f2ccf561752249baac75258733dbf0d0/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:50.517160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f2496-03e2-4349-88dd-1da2b50aebb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7b8785660045d19d4ea3a84d05d214, user_id=f2ccf561752249baac75258733dbf0d0, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:50.520319 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f2496-03e2-4349-88dd-1da2b50aebb0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:50.618100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1345/2703] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:50 2022] PUT /identity/v3/projects/8b7b8785660045d19d4ea3a84d05d214/users/f2ccf561752249baac75258733dbf0d0/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:50.621734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916326a1-7d00-4e83-ae3f-118f9fc5b8a2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:50.622136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916326a1-7d00-4e83-ae3f-118f9fc5b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:50.622514 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916326a1-7d00-4e83-ae3f-118f9fc5b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:50.660496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-916326a1-7d00-4e83-ae3f-118f9fc5b8a2 None None] MFA Rules not processed for user `f2ccf561752249baac75258733dbf0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:50.663124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-916326a1-7d00-4e83-ae3f-118f9fc5b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:50.750323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1359/2704] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:50.754925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f2496-03e2-4349-88dd-1da2b50aebb0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:50.831806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f2496-03e2-4349-88dd-1da2b50aebb0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:50.839912 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b1599-36d7-4657-b181-4d1c1252719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:50.840562 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1599-36d7-4657-b181-4d1c1252719d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:50.840844 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1599-36d7-4657-b181-4d1c1252719d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:50.841118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1599-36d7-4657-b181-4d1c1252719d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:50.841773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b1599-36d7-4657-b181-4d1c1252719d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:50.843702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b1599-36d7-4657-b181-4d1c1252719d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:50.960446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1346/2705] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:29:50 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:29:50.964193 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916326a1-7d00-4e83-ae3f-118f9fc5b8a2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:50.975525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916326a1-7d00-4e83-ae3f-118f9fc5b8a2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:51.042986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0f7ee-857e-4119-bd6b-6dcedfa9a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:51.043654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0f7ee-857e-4119-bd6b-6dcedfa9a323 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:51.044010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0f7ee-857e-4119-bd6b-6dcedfa9a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:51.044384 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0f7ee-857e-4119-bd6b-6dcedfa9a323 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:51.045100 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0f7ee-857e-4119-bd6b-6dcedfa9a323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:51.047110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0f7ee-857e-4119-bd6b-6dcedfa9a323 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:51.137793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1360/2706] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:29:50 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:29:51.141875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b1599-36d7-4657-b181-4d1c1252719d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:51.157585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b1599-36d7-4657-b181-4d1c1252719d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:51.162872 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff90346-1c8a-4d6d-acb0-99e21e963526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:51.165465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff90346-1c8a-4d6d-acb0-99e21e963526 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:51.165465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff90346-1c8a-4d6d-acb0-99e21e963526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:51.165465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff90346-1c8a-4d6d-acb0-99e21e963526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:51.165465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff90346-1c8a-4d6d-acb0-99e21e963526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:51.167479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff90346-1c8a-4d6d-acb0-99e21e963526 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:51.179299 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1347/2707] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:51.184142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0f7ee-857e-4119-bd6b-6dcedfa9a323 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:51.195277 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0f7ee-857e-4119-bd6b-6dcedfa9a323 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:51.205580 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced7d80-4f71-45d2-944e-53c2d47889ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:51.206256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced7d80-4f71-45d2-944e-53c2d47889ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:51.206535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced7d80-4f71-45d2-944e-53c2d47889ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:51.206830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced7d80-4f71-45d2-944e-53c2d47889ea admin admin] PATH_INFO: `/v3/projects/5364dec1743f4e69b3a279bd044484a2/users/f18aa01c168843e08aea5ec5ec4167e1/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:51.229712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced7d80-4f71-45d2-944e-53c2d47889ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5364dec1743f4e69b3a279bd044484a2, user_id=f18aa01c168843e08aea5ec5ec4167e1, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:51.233004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced7d80-4f71-45d2-944e-53c2d47889ea admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:51.348697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1361/2708] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:51 2022] PUT /identity/v3/projects/5364dec1743f4e69b3a279bd044484a2/users/f18aa01c168843e08aea5ec5ec4167e1/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:29:51.357154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff90346-1c8a-4d6d-acb0-99e21e963526 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:51.371606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff90346-1c8a-4d6d-acb0-99e21e963526 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:51.435344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:51.443068 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42923d-7df8-450d-9cf4-0cfa64457ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:51.443704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42923d-7df8-450d-9cf4-0cfa64457ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:51.443983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42923d-7df8-450d-9cf4-0cfa64457ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:51.444443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42923d-7df8-450d-9cf4-0cfa64457ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:51.444965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42923d-7df8-450d-9cf4-0cfa64457ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:51.446627 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42923d-7df8-450d-9cf4-0cfa64457ae4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:51.457491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1348/2709] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:29:51.462006 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced7d80-4f71-45d2-944e-53c2d47889ea admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:51.475915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced7d80-4f71-45d2-944e-53c2d47889ea admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:51.484591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c40ce9-5bfc-47b4-b7ec-9e137952bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:51.484591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c40ce9-5bfc-47b4-b7ec-9e137952bf75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:51.484591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c40ce9-5bfc-47b4-b7ec-9e137952bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:51.484855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c40ce9-5bfc-47b4-b7ec-9e137952bf75 admin admin] PATH_INFO: `/v3/projects/5364dec1743f4e69b3a279bd044484a2/users/f18aa01c168843e08aea5ec5ec4167e1/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:51.490144 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c40ce9-5bfc-47b4-b7ec-9e137952bf75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5364dec1743f4e69b3a279bd044484a2, user_id=f18aa01c168843e08aea5ec5ec4167e1, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:51.493335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c40ce9-5bfc-47b4-b7ec-9e137952bf75 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:51.509997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1362/2710] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:29:51 2022] PUT /identity/v3/projects/5364dec1743f4e69b3a279bd044484a2/users/f18aa01c168843e08aea5ec5ec4167e1/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:29:51.525524 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ea88-b48f-4f37-914c-ce1eba0b03a6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:51.525893 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ea88-b48f-4f37-914c-ce1eba0b03a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:51.526808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ea88-b48f-4f37-914c-ce1eba0b03a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:51.560674 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f6d5ea88-b48f-4f37-914c-ce1eba0b03a6 None None] MFA Rules not processed for user `f18aa01c168843e08aea5ec5ec4167e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:51.562231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f6d5ea88-b48f-4f37-914c-ce1eba0b03a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:51.637421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1349/2711] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:51.649131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c40ce9-5bfc-47b4-b7ec-9e137952bf75 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:51.650916 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-95c40ce9-5bfc-47b4-b7ec-9e137952bf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:51.671528 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:29:51.712721 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c40ce9-5bfc-47b4-b7ec-9e137952bf75 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:51.717008 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faddba3-579c-48a7-8294-710169e61423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:51.717602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faddba3-579c-48a7-8294-710169e61423 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:51.717879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faddba3-579c-48a7-8294-710169e61423 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:51.718150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faddba3-579c-48a7-8294-710169e61423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:51.727321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faddba3-579c-48a7-8294-710169e61423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:51.728819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faddba3-579c-48a7-8294-710169e61423 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:51.738566 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1363/2712] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:53.233991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8259-74e8-4f6f-afe3-e9ef0516fc69 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:53.235841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8259-74e8-4f6f-afe3-e9ef0516fc69 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:53.235841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de8259-74e8-4f6f-afe3-e9ef0516fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:53.253768 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-59de8259-74e8-4f6f-afe3-e9ef0516fc69 None None] MFA Rules not processed for user `18dbef22f86a4a56ada3a86175d576e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:53.254982 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59de8259-74e8-4f6f-afe3-e9ef0516fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:53.274846 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faddba3-579c-48a7-8294-710169e61423 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:53.284483 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faddba3-579c-48a7-8294-710169e61423 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:53.288284 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd959d-bd96-4608-a93b-18c5e6348315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:53.288887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd959d-bd96-4608-a93b-18c5e6348315 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:53.289168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd959d-bd96-4608-a93b-18c5e6348315 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:53.289442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd959d-bd96-4608-a93b-18c5e6348315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:53.317262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1350/2713] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:29:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:53.350861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd959d-bd96-4608-a93b-18c5e6348315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:53.352419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd959d-bd96-4608-a93b-18c5e6348315 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:53.362220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1364/2714] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:29:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:29:57.169607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63a1fe-7413-4222-9019-ec3f33c382c6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:57.170132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63a1fe-7413-4222-9019-ec3f33c382c6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:57.170234 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63a1fe-7413-4222-9019-ec3f33c382c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:57.189808 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4b63a1fe-7413-4222-9019-ec3f33c382c6 None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:29:57.191123 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4b63a1fe-7413-4222-9019-ec3f33c382c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:57.249822 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1351/2715] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Sep 1 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:29:57.262454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd959d-bd96-4608-a93b-18c5e6348315 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:29:57.263868 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-69bd959d-bd96-4608-a93b-18c5e6348315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:29:57.341505 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd959d-bd96-4608-a93b-18c5e6348315 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:29:57.346649 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f686e-40cb-4509-8425-55ab771b00dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:29:57.347395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f686e-40cb-4509-8425-55ab771b00dc service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:29:57.347681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f686e-40cb-4509-8425-55ab771b00dc service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:29:57.347955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f686e-40cb-4509-8425-55ab771b00dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:29:57.356327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f686e-40cb-4509-8425-55ab771b00dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:29:57.357933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f686e-40cb-4509-8425-55ab771b00dc service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:29:57.366658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1365/2716] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:29:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:30:00.706483 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63a1fe-7413-4222-9019-ec3f33c382c6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:00.714790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63a1fe-7413-4222-9019-ec3f33c382c6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:00.718765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d4dbb-8e97-4948-bdd5-030ed0016970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:00.719635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d4dbb-8e97-4948-bdd5-030ed0016970 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:00.720311 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d4dbb-8e97-4948-bdd5-030ed0016970 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:00.720801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d4dbb-8e97-4948-bdd5-030ed0016970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:00.752352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:00.794732 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d4dbb-8e97-4948-bdd5-030ed0016970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:00.796394 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d4dbb-8e97-4948-bdd5-030ed0016970 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:00.807671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1352/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:05.685274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f686e-40cb-4509-8425-55ab771b00dc service swift] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:05.733592 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:05.748140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f686e-40cb-4509-8425-55ab771b00dc service swift] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:05.752706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:05.756140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:05.756140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:05.756140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] PATH_INFO: `/v3/users/a6f6f7e0997d405cadebf8a3796cfc7f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:05.756140 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f6f7e0997d405cadebf8a3796cfc7f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:05.757034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:06.014790 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f6f7e0997d405cadebf8a3796cfc7f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:06.021474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f6f7e0997d405cadebf8a3796cfc7f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:06.022110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f6f7e0997d405cadebf8a3796cfc7f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:06.150551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f6f7e0997d405cadebf8a3796cfc7f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:06.163502 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f6f7e0997d405cadebf8a3796cfc7f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:06.175074 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1366/2718] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:05 2022] DELETE /identity/v3/users/a6f6f7e0997d405cadebf8a3796cfc7f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:06.175191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b494-a8b0-475a-b0af-7722f25d1b69 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:06.175191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b494-a8b0-475a-b0af-7722f25d1b69 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:06.175191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b494-a8b0-475a-b0af-7722f25d1b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:06.193781 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5472b494-a8b0-475a-b0af-7722f25d1b69 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:06.194983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5472b494-a8b0-475a-b0af-7722f25d1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:06.256935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1353/2719] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:06.268496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:06.268717 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:06.327525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486421f9-6cf4-4087-9be3-8bae812d743b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:06.331179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c7eac-7b18-418b-983a-b45604e3c867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:06.331787 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c7eac-7b18-418b-983a-b45604e3c867 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:06.332230 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c7eac-7b18-418b-983a-b45604e3c867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:06.332519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c7eac-7b18-418b-983a-b45604e3c867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:06.344378 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c7eac-7b18-418b-983a-b45604e3c867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:06.345816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c7eac-7b18-418b-983a-b45604e3c867 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:06.356149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1367/2720] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:06.786689 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472b494-a8b0-475a-b0af-7722f25d1b69 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:06.794369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5472b494-a8b0-475a-b0af-7722f25d1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:06.802051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472b494-a8b0-475a-b0af-7722f25d1b69 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:06.807157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:06.808427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:06.808850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:06.809132 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] PATH_INFO: `/v3/projects/5b2b03e439f34976b02a25fb4f910832` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:06.810673 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2b03e439f34976b02a25fb4f910832)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:06.812742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:06.957097 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2b03e439f34976b02a25fb4f910832', 'request_id': 'req-692a1825-af20-4679-9bd2-b9cc55dbe54b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:06.968319 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2b03e439f34976b02a25fb4f910832', 'request_id': 'req-692a1825-af20-4679-9bd2-b9cc55dbe54b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:06.975320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2b03e439f34976b02a25fb4f910832', 'request_id': 'req-692a1825-af20-4679-9bd2-b9cc55dbe54b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:07.121577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] The token cache is being invalidate because project 5b2b03e439f34976b02a25fb4f910832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:07.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:07.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:07.128419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1354/2721] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:06 2022] DELETE /identity/v3/projects/5b2b03e439f34976b02a25fb4f910832 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:07.136620 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c7eac-7b18-418b-983a-b45604e3c867 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:07.148755 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c7eac-7b18-418b-983a-b45604e3c867 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:07.212027 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:07.212611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:07.212894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:07.213166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] PATH_INFO: `/v3/users/f2ccf561752249baac75258733dbf0d0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:07.214361 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ccf561752249baac75258733dbf0d0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:07.216307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:07.229490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:07.400153 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ccf561752249baac75258733dbf0d0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:07.407533 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ccf561752249baac75258733dbf0d0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:07.408229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ccf561752249baac75258733dbf0d0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:07.453610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ccf561752249baac75258733dbf0d0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:07.466364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ccf561752249baac75258733dbf0d0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:07.472285 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1368/2722] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:07 2022] DELETE /identity/v3/users/f2ccf561752249baac75258733dbf0d0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:07.937003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:07.938479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:07.951770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a1825-af20-4679-9bd2-b9cc55dbe54b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:08.064155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:08.064155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:08.064155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:08.064155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:08.064736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] PATH_INFO: `/v3/projects/8b7b8785660045d19d4ea3a84d05d214` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:08.064736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7b8785660045d19d4ea3a84d05d214)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:08.064736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:08.966851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:08.966851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:09.003462 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7b8785660045d19d4ea3a84d05d214', 'request_id': 'req-a01c5166-fc56-436d-aea5-d1f7fedf552e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:09.009676 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7b8785660045d19d4ea3a84d05d214', 'request_id': 'req-a01c5166-fc56-436d-aea5-d1f7fedf552e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:09.016776 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7b8785660045d19d4ea3a84d05d214', 'request_id': 'req-a01c5166-fc56-436d-aea5-d1f7fedf552e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:09.022031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598abb0-3481-4aed-8950-241f6209d2c9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:09.070703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e766a9-c82d-499b-be83-40bb807a04c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:09.071310 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e766a9-c82d-499b-be83-40bb807a04c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:09.077371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e766a9-c82d-499b-be83-40bb807a04c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:09.077371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e766a9-c82d-499b-be83-40bb807a04c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:09.077371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e3e766a9-c82d-499b-be83-40bb807a04c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:09.083467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e766a9-c82d-499b-be83-40bb807a04c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:09.084933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e766a9-c82d-499b-be83-40bb807a04c5 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:09.093137 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1369/2723] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:30:09.111391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] The token cache is being invalidate because project 8b7b8785660045d19d4ea3a84d05d214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:09.118370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:09.118370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:09.118370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1355/2724] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:07 2022] DELETE /identity/v3/projects/8b7b8785660045d19d4ea3a84d05d214 => generated 0 bytes in 1179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:09.118705 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e766a9-c82d-499b-be83-40bb807a04c5 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:09.120965 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e3e766a9-c82d-499b-be83-40bb807a04c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:09.172112 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:09.189729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e766a9-c82d-499b-be83-40bb807a04c5 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:09.194714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:09.195334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:09.195610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:09.195880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] PATH_INFO: `/v3/users/f18aa01c168843e08aea5ec5ec4167e1` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:09.197089 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18aa01c168843e08aea5ec5ec4167e1)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:09.199060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:09.412956 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18aa01c168843e08aea5ec5ec4167e1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:09.420788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18aa01c168843e08aea5ec5ec4167e1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:09.421656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18aa01c168843e08aea5ec5ec4167e1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:09.493921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18aa01c168843e08aea5ec5ec4167e1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:09.507317 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18aa01c168843e08aea5ec5ec4167e1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:09.515110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1370/2725] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:09 2022] DELETE /identity/v3/users/f18aa01c168843e08aea5ec5ec4167e1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:09.926712 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:09.928379 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:10.009863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:10.011090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:10.018828 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c5166-fc56-436d-aea5-d1f7fedf552e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:10.101536 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a1e01-e90a-4bef-bc95-c4632723f3a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:10.102070 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a1e01-e90a-4bef-bc95-c4632723f3a5 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:10.102347 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a1e01-e90a-4bef-bc95-c4632723f3a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:10.102620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a1e01-e90a-4bef-bc95-c4632723f3a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:10.104489 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-447a1e01-e90a-4bef-bc95-c4632723f3a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:10.105441 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f42b8-c2dc-4e59-b4db-4d624dbc51af admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:10.114311 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:10.115031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:10.116353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:10.116640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] PATH_INFO: `/v3/projects/5364dec1743f4e69b3a279bd044484a2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:10.119593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5364dec1743f4e69b3a279bd044484a2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:10.121775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:10.123037 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a1e01-e90a-4bef-bc95-c4632723f3a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:10.124933 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a1e01-e90a-4bef-bc95-c4632723f3a5 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:10.138095 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1356/2726] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:10.271705 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5364dec1743f4e69b3a279bd044484a2', 'request_id': 'req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:10.278748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5364dec1743f4e69b3a279bd044484a2', 'request_id': 'req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:10.384858 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5364dec1743f4e69b3a279bd044484a2', 'request_id': 'req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:10.390719 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:10.397292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] The token cache is being invalidate because project 5364dec1743f4e69b3a279bd044484a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:10.397586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:10.398247 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-35cc3636-05da-4bd8-8e7a-7e4b5be6f4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:10.399771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1371/2727] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:10 2022] DELETE /identity/v3/projects/5364dec1743f4e69b3a279bd044484a2 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:10.405751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62246-ace4-42b4-9774-7a76d5ffec4a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:10.406043 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62246-ace4-42b4-9774-7a76d5ffec4a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:10.406326 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62246-ace4-42b4-9774-7a76d5ffec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:10.414053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:10.426327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f9b62246-ace4-42b4-9774-7a76d5ffec4a None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:10.427541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f9b62246-ace4-42b4-9774-7a76d5ffec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:10.488224 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1357/2728] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:10.498867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e35ad2-9fb3-436d-978b-507a201545e4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:10.499154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e35ad2-9fb3-436d-978b-507a201545e4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:10.499429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e35ad2-9fb3-436d-978b-507a201545e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:10.519707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-61e35ad2-9fb3-436d-978b-507a201545e4 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:10.520946 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-61e35ad2-9fb3-436d-978b-507a201545e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:10.529398 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1372/2729] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:10.533816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b62246-ace4-42b4-9774-7a76d5ffec4a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:10.544730 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b62246-ace4-42b4-9774-7a76d5ffec4a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:10.549722 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f47799-d20c-4feb-b2da-4f67701272ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:10.550371 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47799-d20c-4feb-b2da-4f67701272ca admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:10.550662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47799-d20c-4feb-b2da-4f67701272ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:10.550952 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47799-d20c-4feb-b2da-4f67701272ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:10.551645 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47799-d20c-4feb-b2da-4f67701272ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:30:10.551881 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47799-d20c-4feb-b2da-4f67701272ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:10.553533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47799-d20c-4feb-b2da-4f67701272ca admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:10.566410 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1358/2730] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:30:10.570842 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e35ad2-9fb3-436d-978b-507a201545e4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:10.580633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e35ad2-9fb3-436d-978b-507a201545e4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:10.585581 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9693cdc-b3d6-47d3-97ea-37b21a57a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:10.586218 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9693cdc-b3d6-47d3-97ea-37b21a57a17a admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:10.586511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9693cdc-b3d6-47d3-97ea-37b21a57a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:10.586771 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9693cdc-b3d6-47d3-97ea-37b21a57a17a admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:10.587428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9693cdc-b3d6-47d3-97ea-37b21a57a17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:10.589345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9693cdc-b3d6-47d3-97ea-37b21a57a17a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:10.695633 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1373/2731] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:10 2022] POST /identity/v3/projects => generated 401 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:10.699919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f47799-d20c-4feb-b2da-4f67701272ca admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:10.709963 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f47799-d20c-4feb-b2da-4f67701272ca admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:10.765479 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc3297-b3a5-4289-8173-ed849d0187ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:10.766089 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3297-b3a5-4289-8173-ed849d0187ac admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:10.766367 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3297-b3a5-4289-8173-ed849d0187ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:10.766643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3297-b3a5-4289-8173-ed849d0187ac admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:10.767270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc3297-b3a5-4289-8173-ed849d0187ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:10.769220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc3297-b3a5-4289-8173-ed849d0187ac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:10.888679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1359/2732] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:10 2022] POST /identity/v3/users => generated 301 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:10.893336 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9693cdc-b3d6-47d3-97ea-37b21a57a17a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:10.904671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9693cdc-b3d6-47d3-97ea-37b21a57a17a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:10.909693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970af1fd-8c67-4ccf-b3d2-1485f0f0e327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:10.910296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970af1fd-8c67-4ccf-b3d2-1485f0f0e327 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:10.910672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970af1fd-8c67-4ccf-b3d2-1485f0f0e327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:10.910959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970af1fd-8c67-4ccf-b3d2-1485f0f0e327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:10.911606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970af1fd-8c67-4ccf-b3d2-1485f0f0e327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:10.913228 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970af1fd-8c67-4ccf-b3d2-1485f0f0e327 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:10.924378 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1374/2733] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:10.928402 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc3297-b3a5-4289-8173-ed849d0187ac admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:10.938507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc3297-b3a5-4289-8173-ed849d0187ac admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:10.943093 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94b7c9-16f8-4f19-a7c4-e359ccfd4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:10.943691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94b7c9-16f8-4f19-a7c4-e359ccfd4294 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:10.943971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94b7c9-16f8-4f19-a7c4-e359ccfd4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:10.944280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94b7c9-16f8-4f19-a7c4-e359ccfd4294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:10.944945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94b7c9-16f8-4f19-a7c4-e359ccfd4294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:10.946519 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94b7c9-16f8-4f19-a7c4-e359ccfd4294 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:10.957559 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1360/2734] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:10.961993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970af1fd-8c67-4ccf-b3d2-1485f0f0e327 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:10.973915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970af1fd-8c67-4ccf-b3d2-1485f0f0e327 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:10.978832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacecb01-7052-4265-b5cd-99e20f60f277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:10.980154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacecb01-7052-4265-b5cd-99e20f60f277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:10.980536 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacecb01-7052-4265-b5cd-99e20f60f277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:10.980829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacecb01-7052-4265-b5cd-99e20f60f277 admin admin] PATH_INFO: `/v3/projects/b096f7b8d0934de1a38256c18e4f8705/users/1998dd0a109244c0847549e5404aac49/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:10.996082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacecb01-7052-4265-b5cd-99e20f60f277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b096f7b8d0934de1a38256c18e4f8705, user_id=1998dd0a109244c0847549e5404aac49, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:10.998786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacecb01-7052-4265-b5cd-99e20f60f277 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:11.099783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1375/2735] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:10 2022] PUT /identity/v3/projects/b096f7b8d0934de1a38256c18e4f8705/users/1998dd0a109244c0847549e5404aac49/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:11.111780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07751-0115-4110-869f-db5f8c82cb0f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:11.112342 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07751-0115-4110-869f-db5f8c82cb0f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:11.114387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07751-0115-4110-869f-db5f8c82cb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:11.143156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-31c07751-0115-4110-869f-db5f8c82cb0f None None] MFA Rules not processed for user `1998dd0a109244c0847549e5404aac49`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:11.144331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-31c07751-0115-4110-869f-db5f8c82cb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:11.205620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:11.211124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1361/2736] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:11.216154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacecb01-7052-4265-b5cd-99e20f60f277 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:11.278803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacecb01-7052-4265-b5cd-99e20f60f277 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:11.283550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c35797-2c7c-46ba-8ab6-a87e59418ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:11.284156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c35797-2c7c-46ba-8ab6-a87e59418ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:11.284460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c35797-2c7c-46ba-8ab6-a87e59418ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:11.284731 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c35797-2c7c-46ba-8ab6-a87e59418ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:11.285370 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c35797-2c7c-46ba-8ab6-a87e59418ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:11.287352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c35797-2c7c-46ba-8ab6-a87e59418ff9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:11.398412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1376/2737] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:11 2022] POST /identity/v3/projects => generated 401 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:11.401445 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c07751-0115-4110-869f-db5f8c82cb0f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:11.412408 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c07751-0115-4110-869f-db5f8c82cb0f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:11.473806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23666be-cbe1-42b2-b3d8-e0456d9bcc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:11.474419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23666be-cbe1-42b2-b3d8-e0456d9bcc96 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:11.474727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23666be-cbe1-42b2-b3d8-e0456d9bcc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:11.475002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23666be-cbe1-42b2-b3d8-e0456d9bcc96 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:11.475660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23666be-cbe1-42b2-b3d8-e0456d9bcc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:11.477607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23666be-cbe1-42b2-b3d8-e0456d9bcc96 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:11.573778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1362/2738] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:11 2022] POST /identity/v3/users => generated 307 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:11.577913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c35797-2c7c-46ba-8ab6-a87e59418ff9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:11.588972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c35797-2c7c-46ba-8ab6-a87e59418ff9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:11.593542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c2796-43f1-4d3b-bf6f-e004926f7115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:11.594132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2796-43f1-4d3b-bf6f-e004926f7115 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:11.594412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2796-43f1-4d3b-bf6f-e004926f7115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:11.594718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2796-43f1-4d3b-bf6f-e004926f7115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:11.595357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c2796-43f1-4d3b-bf6f-e004926f7115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:11.596988 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c2796-43f1-4d3b-bf6f-e004926f7115 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:11.608072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1377/2739] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:11.612236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23666be-cbe1-42b2-b3d8-e0456d9bcc96 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:11.623468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23666be-cbe1-42b2-b3d8-e0456d9bcc96 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:11.628072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c1526-7ce9-44ff-9938-39890aef796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:11.628751 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1526-7ce9-44ff-9938-39890aef796b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:11.629027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1526-7ce9-44ff-9938-39890aef796b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:11.629298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1526-7ce9-44ff-9938-39890aef796b admin admin] PATH_INFO: `/v3/projects/46cfa98305034c9488e41803542c6117/users/b37a3bb09d824b0392a52caf1455f24a/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:11.793180 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c1526-7ce9-44ff-9938-39890aef796b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cfa98305034c9488e41803542c6117, user_id=b37a3bb09d824b0392a52caf1455f24a, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:11.795865 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c1526-7ce9-44ff-9938-39890aef796b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:11.909997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1363/2740] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:11 2022] PUT /identity/v3/projects/46cfa98305034c9488e41803542c6117/users/b37a3bb09d824b0392a52caf1455f24a/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:11.911034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c2796-43f1-4d3b-bf6f-e004926f7115 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:11.926052 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c2796-43f1-4d3b-bf6f-e004926f7115 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:11.995325 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff36e0-2c90-402b-829f-2d63381b93f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:11.995879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff36e0-2c90-402b-829f-2d63381b93f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:11.996168 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff36e0-2c90-402b-829f-2d63381b93f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:11.996474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff36e0-2c90-402b-829f-2d63381b93f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:11.997119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff36e0-2c90-402b-829f-2d63381b93f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:11.998695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff36e0-2c90-402b-829f-2d63381b93f9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:12.009119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1378/2741] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:12.014013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c1526-7ce9-44ff-9938-39890aef796b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:12.025113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c1526-7ce9-44ff-9938-39890aef796b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:12.030355 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058a0da-8d5e-482c-a52a-f2a37e1215e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:12.035718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058a0da-8d5e-482c-a52a-f2a37e1215e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:12.035718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058a0da-8d5e-482c-a52a-f2a37e1215e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:12.035718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058a0da-8d5e-482c-a52a-f2a37e1215e7 admin admin] PATH_INFO: `/v3/projects/46cfa98305034c9488e41803542c6117/users/b37a3bb09d824b0392a52caf1455f24a/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:12.035718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058a0da-8d5e-482c-a52a-f2a37e1215e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cfa98305034c9488e41803542c6117, user_id=b37a3bb09d824b0392a52caf1455f24a, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:12.036814 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058a0da-8d5e-482c-a52a-f2a37e1215e7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:12.047597 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1364/2742] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:12 2022] PUT /identity/v3/projects/46cfa98305034c9488e41803542c6117/users/b37a3bb09d824b0392a52caf1455f24a/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:12.058913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60fe49-6b94-4551-8ab2-17a2e1f7c4b0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:12.059205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60fe49-6b94-4551-8ab2-17a2e1f7c4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:12.059484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60fe49-6b94-4551-8ab2-17a2e1f7c4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:12.066669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:12.089811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bc60fe49-6b94-4551-8ab2-17a2e1f7c4b0 None None] MFA Rules not processed for user `b37a3bb09d824b0392a52caf1455f24a`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:12.091063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bc60fe49-6b94-4551-8ab2-17a2e1f7c4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:12.164058 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1379/2743] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:12.175359 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058a0da-8d5e-482c-a52a-f2a37e1215e7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:12.177344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3058a0da-8d5e-482c-a52a-f2a37e1215e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:12.236286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058a0da-8d5e-482c-a52a-f2a37e1215e7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:12.239999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f52c6-698a-4c93-858e-0d930d95e23b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:12.240691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f52c6-698a-4c93-858e-0d930d95e23b service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:12.241236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f52c6-698a-4c93-858e-0d930d95e23b service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:12.241517 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f52c6-698a-4c93-858e-0d930d95e23b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:12.250929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f52c6-698a-4c93-858e-0d930d95e23b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:12.252426 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f52c6-698a-4c93-858e-0d930d95e23b service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:12.262440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1365/2744] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:12 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:12.593383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60fe49-6b94-4551-8ab2-17a2e1f7c4b0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:12.595324 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bc60fe49-6b94-4551-8ab2-17a2e1f7c4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:12.608292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60fe49-6b94-4551-8ab2-17a2e1f7c4b0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:12.612046 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b3913-2909-46da-b98b-6a645faf56ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:12.612693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b3913-2909-46da-b98b-6a645faf56ae service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:12.613034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b3913-2909-46da-b98b-6a645faf56ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:12.613327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b3913-2909-46da-b98b-6a645faf56ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:12.681513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b3913-2909-46da-b98b-6a645faf56ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:12.686487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b3913-2909-46da-b98b-6a645faf56ae service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:12.697899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1380/2745] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:12 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:17.886194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f52c6-698a-4c93-858e-0d930d95e23b service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:17.937502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:17.947992 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f52c6-698a-4c93-858e-0d930d95e23b service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:17.952606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:17.953223 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:17.953497 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:17.953762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] PATH_INFO: `/v3/users/1998dd0a109244c0847549e5404aac49` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:17.954854 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1998dd0a109244c0847549e5404aac49)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:17.956769 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:18.222343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1998dd0a109244c0847549e5404aac49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:18.229179 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1998dd0a109244c0847549e5404aac49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:18.339694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1998dd0a109244c0847549e5404aac49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:18.340378 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1998dd0a109244c0847549e5404aac49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:18.341018 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1998dd0a109244c0847549e5404aac49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:18.358832 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1366/2746] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:17 2022] DELETE /identity/v3/users/1998dd0a109244c0847549e5404aac49 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:18.363308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2f4dc-fb95-4176-a94f-448e59829ab9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:18.363758 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2f4dc-fb95-4176-a94f-448e59829ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:18.363871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2f4dc-fb95-4176-a94f-448e59829ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:18.382992 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fbd2f4dc-fb95-4176-a94f-448e59829ab9 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:18.384238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fbd2f4dc-fb95-4176-a94f-448e59829ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:18.442017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1381/2747] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:30:18.452291 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:18.453775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:18.513526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66e45f-c55f-4db9-85d1-f4589748fd2a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:18.517214 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def193e-c22c-4666-b784-8cf9694178f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:18.517818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def193e-c22c-4666-b784-8cf9694178f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:18.518099 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def193e-c22c-4666-b784-8cf9694178f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:18.518373 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def193e-c22c-4666-b784-8cf9694178f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:18.527351 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def193e-c22c-4666-b784-8cf9694178f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:18.528818 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def193e-c22c-4666-b784-8cf9694178f5 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:18.538481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1367/2748] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:19.060801 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2f4dc-fb95-4176-a94f-448e59829ab9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:19.062337 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fbd2f4dc-fb95-4176-a94f-448e59829ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:19.082412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2f4dc-fb95-4176-a94f-448e59829ab9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:19.100730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:19.100730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:19.100730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:19.100730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] PATH_INFO: `/v3/projects/b096f7b8d0934de1a38256c18e4f8705` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:19.101316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b096f7b8d0934de1a38256c18e4f8705)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:19.101316 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:19.136527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:19.242357 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b096f7b8d0934de1a38256c18e4f8705', 'request_id': 'req-67ec5dee-7806-48a4-8baa-c020ded08ceb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:19.248547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b096f7b8d0934de1a38256c18e4f8705', 'request_id': 'req-67ec5dee-7806-48a4-8baa-c020ded08ceb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:19.327415 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b096f7b8d0934de1a38256c18e4f8705', 'request_id': 'req-67ec5dee-7806-48a4-8baa-c020ded08ceb'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:19.339200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] The token cache is being invalidate because project b096f7b8d0934de1a38256c18e4f8705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:19.339606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:19.340149 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:19.341695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1382/2749] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:19 2022] DELETE /identity/v3/projects/b096f7b8d0934de1a38256c18e4f8705 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:19.345929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def193e-c22c-4666-b784-8cf9694178f5 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:19.356448 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def193e-c22c-4666-b784-8cf9694178f5 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:19.413868 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:19.414499 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:19.414789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:19.415078 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] PATH_INFO: `/v3/users/b37a3bb09d824b0392a52caf1455f24a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:19.416222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37a3bb09d824b0392a52caf1455f24a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:19.418925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:19.436563 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:19.599726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37a3bb09d824b0392a52caf1455f24a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:19.606882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37a3bb09d824b0392a52caf1455f24a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:19.693147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37a3bb09d824b0392a52caf1455f24a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:19.693834 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37a3bb09d824b0392a52caf1455f24a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:19.694490 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db71181a-351f-4a1b-9099-6f4abce4d0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37a3bb09d824b0392a52caf1455f24a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:19.716904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1368/2750] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:19 2022] DELETE /identity/v3/users/b37a3bb09d824b0392a52caf1455f24a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:20.123492 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:20.125060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:20.140493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec5dee-7806-48a4-8baa-c020ded08ceb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:20.200802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:20.201509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:20.201790 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:20.202062 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] PATH_INFO: `/v3/projects/46cfa98305034c9488e41803542c6117` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:20.203467 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46cfa98305034c9488e41803542c6117)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:20.205451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:20.322209 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46cfa98305034c9488e41803542c6117', 'request_id': 'req-aac37e7e-d0a3-425d-934e-a923b85b33c2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:20.329097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46cfa98305034c9488e41803542c6117', 'request_id': 'req-aac37e7e-d0a3-425d-934e-a923b85b33c2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:20.429022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46cfa98305034c9488e41803542c6117', 'request_id': 'req-aac37e7e-d0a3-425d-934e-a923b85b33c2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:20.440779 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] The token cache is being invalidate because project 46cfa98305034c9488e41803542c6117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:20.441485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:20.441710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-aac37e7e-d0a3-425d-934e-a923b85b33c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:20.443473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1383/2751] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:20 2022] DELETE /identity/v3/projects/46cfa98305034c9488e41803542c6117 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:20.448646 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c2e6-c2f5-454d-a130-27a817b51806 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:20.449094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c2e6-c2f5-454d-a130-27a817b51806 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:20.449201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c2e6-c2f5-454d-a130-27a817b51806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:20.469594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e722c2e6-c2f5-454d-a130-27a817b51806 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:20.470793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e722c2e6-c2f5-454d-a130-27a817b51806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:20.531339 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1369/2752] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:20.539115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb58742-011e-4182-b2b6-3743f8755c3b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:20.539426 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb58742-011e-4182-b2b6-3743f8755c3b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:20.539726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb58742-011e-4182-b2b6-3743f8755c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:20.559271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1bb58742-011e-4182-b2b6-3743f8755c3b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:20.560550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1bb58742-011e-4182-b2b6-3743f8755c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:20.568468 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1384/2753] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:20.573336 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722c2e6-c2f5-454d-a130-27a817b51806 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:20.584607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722c2e6-c2f5-454d-a130-27a817b51806 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:20.589973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d2a81-bb4c-47a6-8978-36f68584c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:20.590574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d2a81-bb4c-47a6-8978-36f68584c853 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:20.590850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d2a81-bb4c-47a6-8978-36f68584c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:20.591112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d2a81-bb4c-47a6-8978-36f68584c853 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:20.591816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d2a81-bb4c-47a6-8978-36f68584c853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:30:20.592117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d2a81-bb4c-47a6-8978-36f68584c853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:20.594773 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d2a81-bb4c-47a6-8978-36f68584c853 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:20.611110 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1370/2754] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:30:20.612386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb58742-011e-4182-b2b6-3743f8755c3b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:20.622526 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb58742-011e-4182-b2b6-3743f8755c3b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:20.628468 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefbbac-8b97-41b8-9718-42ec0766c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:20.629202 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefbbac-8b97-41b8-9718-42ec0766c932 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:20.635882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefbbac-8b97-41b8-9718-42ec0766c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:20.635882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefbbac-8b97-41b8-9718-42ec0766c932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:20.635882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefbbac-8b97-41b8-9718-42ec0766c932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:20.635882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefbbac-8b97-41b8-9718-42ec0766c932 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:20.735227 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1385/2755] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:20 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:30:20.739546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d2a81-bb4c-47a6-8978-36f68584c853 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:20.750380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d2a81-bb4c-47a6-8978-36f68584c853 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:20.805283 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c92dd7-4783-4e9c-ae1d-705aba41db00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:20.805874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92dd7-4783-4e9c-ae1d-705aba41db00 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:20.806149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92dd7-4783-4e9c-ae1d-705aba41db00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:20.806421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92dd7-4783-4e9c-ae1d-705aba41db00 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:20.807051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c92dd7-4783-4e9c-ae1d-705aba41db00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:20.809447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c92dd7-4783-4e9c-ae1d-705aba41db00 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:20.898810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1371/2756] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:20 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:20.902875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefbbac-8b97-41b8-9718-42ec0766c932 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:20.913544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefbbac-8b97-41b8-9718-42ec0766c932 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:20.918386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3930611-29f5-4df8-8a0c-246d40161336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:20.918984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3930611-29f5-4df8-8a0c-246d40161336 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:20.919263 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3930611-29f5-4df8-8a0c-246d40161336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:20.919535 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3930611-29f5-4df8-8a0c-246d40161336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:20.920310 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3930611-29f5-4df8-8a0c-246d40161336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:20.921907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3930611-29f5-4df8-8a0c-246d40161336 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:20.927260 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:20.932894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1386/2757] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:20.937703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c92dd7-4783-4e9c-ae1d-705aba41db00 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:20.947577 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c92dd7-4783-4e9c-ae1d-705aba41db00 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:20.952922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2f038-c929-4b89-8ad7-007df1b035ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:20.953509 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2f038-c929-4b89-8ad7-007df1b035ee admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:20.953787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2f038-c929-4b89-8ad7-007df1b035ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:20.954062 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2f038-c929-4b89-8ad7-007df1b035ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:20.954700 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2f038-c929-4b89-8ad7-007df1b035ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:20.956320 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2f038-c929-4b89-8ad7-007df1b035ee admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:20.961469 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:20.966366 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1372/2758] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:20.977938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3930611-29f5-4df8-8a0c-246d40161336 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:20.988009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3930611-29f5-4df8-8a0c-246d40161336 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:20.993299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dedbc-30da-443e-905f-2653c3b01a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:20.993987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dedbc-30da-443e-905f-2653c3b01a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:20.994269 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dedbc-30da-443e-905f-2653c3b01a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:20.997921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dedbc-30da-443e-905f-2653c3b01a94 admin admin] PATH_INFO: `/v3/projects/5e80ceade9db42e88ba3b74f903d49f1/users/ac5e15f6f6024e258dd6b1501d9677ae/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:21.012371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dedbc-30da-443e-905f-2653c3b01a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e80ceade9db42e88ba3b74f903d49f1, user_id=ac5e15f6f6024e258dd6b1501d9677ae, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:21.015498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dedbc-30da-443e-905f-2653c3b01a94 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:21.145032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1387/2759] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:20 2022] PUT /identity/v3/projects/5e80ceade9db42e88ba3b74f903d49f1/users/ac5e15f6f6024e258dd6b1501d9677ae/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:21.216141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aaaa0-5561-48c5-80a2-e6974e2e60b2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:21.216456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aaaa0-5561-48c5-80a2-e6974e2e60b2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:21.216738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3aaaa0-5561-48c5-80a2-e6974e2e60b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:21.253967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5c3aaaa0-5561-48c5-80a2-e6974e2e60b2 None None] MFA Rules not processed for user `ac5e15f6f6024e258dd6b1501d9677ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:21.255369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5c3aaaa0-5561-48c5-80a2-e6974e2e60b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:21.320416 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1373/2760] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:21.325047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dedbc-30da-443e-905f-2653c3b01a94 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:21.391392 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dedbc-30da-443e-905f-2653c3b01a94 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:21.396258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bfba-fb94-41cc-95bc-d46193a218ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:21.396872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bfba-fb94-41cc-95bc-d46193a218ce admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:21.397154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bfba-fb94-41cc-95bc-d46193a218ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:21.397430 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bfba-fb94-41cc-95bc-d46193a218ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:21.398097 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55bfba-fb94-41cc-95bc-d46193a218ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:21.399999 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55bfba-fb94-41cc-95bc-d46193a218ce admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:21.542142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1388/2761] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:21 2022] POST /identity/v3/projects => generated 387 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:30:21.549405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aaaa0-5561-48c5-80a2-e6974e2e60b2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:21.562270 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3aaaa0-5561-48c5-80a2-e6974e2e60b2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:21.633812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acaab0-562e-4cba-acc1-11c310bd4cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:21.634556 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acaab0-562e-4cba-acc1-11c310bd4cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:21.634771 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acaab0-562e-4cba-acc1-11c310bd4cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:21.635064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acaab0-562e-4cba-acc1-11c310bd4cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:21.635945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acaab0-562e-4cba-acc1-11c310bd4cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:21.638083 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acaab0-562e-4cba-acc1-11c310bd4cf9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:21.743477 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1374/2762] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:21 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:21.747544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bfba-fb94-41cc-95bc-d46193a218ce admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:21.757703 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bfba-fb94-41cc-95bc-d46193a218ce admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:21.763163 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a35f23-1d0d-4df9-bfe5-79fe3ae63417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:21.763756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a35f23-1d0d-4df9-bfe5-79fe3ae63417 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:21.764038 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a35f23-1d0d-4df9-bfe5-79fe3ae63417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:21.764341 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a35f23-1d0d-4df9-bfe5-79fe3ae63417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:21.764987 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a35f23-1d0d-4df9-bfe5-79fe3ae63417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:21.766576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a35f23-1d0d-4df9-bfe5-79fe3ae63417 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:21.779095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1389/2763] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:30:21.783275 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acaab0-562e-4cba-acc1-11c310bd4cf9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:21.793569 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acaab0-562e-4cba-acc1-11c310bd4cf9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:21.798323 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e4e1f-bd4a-4523-9c07-b7a0b3550438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:21.807816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e4e1f-bd4a-4523-9c07-b7a0b3550438 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:21.807816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e4e1f-bd4a-4523-9c07-b7a0b3550438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:21.807816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e4e1f-bd4a-4523-9c07-b7a0b3550438 admin admin] PATH_INFO: `/v3/projects/7a1c3b9ad89e4272860701c7ccf2560f/users/27ec1fb93cd34c51b53ee720e295b541/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:21.814140 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e4e1f-bd4a-4523-9c07-b7a0b3550438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1c3b9ad89e4272860701c7ccf2560f, user_id=27ec1fb93cd34c51b53ee720e295b541, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:21.816795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e4e1f-bd4a-4523-9c07-b7a0b3550438 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:21.888981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1375/2764] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:21 2022] PUT /identity/v3/projects/7a1c3b9ad89e4272860701c7ccf2560f/users/27ec1fb93cd34c51b53ee720e295b541/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:21.892994 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a35f23-1d0d-4df9-bfe5-79fe3ae63417 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:21.904561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a35f23-1d0d-4df9-bfe5-79fe3ae63417 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:21.961156 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ab30-dcbf-4c36-8e2c-62cd3a8893e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:21.961798 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ab30-dcbf-4c36-8e2c-62cd3a8893e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:21.962085 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ab30-dcbf-4c36-8e2c-62cd3a8893e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:21.962469 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ab30-dcbf-4c36-8e2c-62cd3a8893e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:21.964444 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660ab30-dcbf-4c36-8e2c-62cd3a8893e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:21.966621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660ab30-dcbf-4c36-8e2c-62cd3a8893e1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:21.981292 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1390/2765] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:21.982476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e4e1f-bd4a-4523-9c07-b7a0b3550438 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:21.993657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e4e1f-bd4a-4523-9c07-b7a0b3550438 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:22.001330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3948f5f-42c1-4e5f-b435-85673bfc1329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:22.002004 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3948f5f-42c1-4e5f-b435-85673bfc1329 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:22.004289 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3948f5f-42c1-4e5f-b435-85673bfc1329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:22.004578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3948f5f-42c1-4e5f-b435-85673bfc1329 admin admin] PATH_INFO: `/v3/projects/7a1c3b9ad89e4272860701c7ccf2560f/users/27ec1fb93cd34c51b53ee720e295b541/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:22.006679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3948f5f-42c1-4e5f-b435-85673bfc1329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1c3b9ad89e4272860701c7ccf2560f, user_id=27ec1fb93cd34c51b53ee720e295b541, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:22.009456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3948f5f-42c1-4e5f-b435-85673bfc1329 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:22.020747 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1376/2766] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:21 2022] PUT /identity/v3/projects/7a1c3b9ad89e4272860701c7ccf2560f/users/27ec1fb93cd34c51b53ee720e295b541/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:22.033432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa880ca-0951-4010-bd06-d943e94c4fbc None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:22.033719 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa880ca-0951-4010-bd06-d943e94c4fbc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:22.033996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa880ca-0951-4010-bd06-d943e94c4fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:22.061986 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-daa880ca-0951-4010-bd06-d943e94c4fbc None None] MFA Rules not processed for user `27ec1fb93cd34c51b53ee720e295b541`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:22.063197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-daa880ca-0951-4010-bd06-d943e94c4fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:22.099463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:22.132800 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1391/2767] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:22.176592 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3948f5f-42c1-4e5f-b435-85673bfc1329 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:22.178460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d3948f5f-42c1-4e5f-b435-85673bfc1329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:22.225276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:22.236637 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3948f5f-42c1-4e5f-b435-85673bfc1329 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:22.240308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02196579-0e77-48dd-8b5c-5caa300dd81f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:22.241157 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02196579-0e77-48dd-8b5c-5caa300dd81f service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:22.241427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02196579-0e77-48dd-8b5c-5caa300dd81f service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:22.241694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02196579-0e77-48dd-8b5c-5caa300dd81f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:22.252780 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02196579-0e77-48dd-8b5c-5caa300dd81f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:22.254279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02196579-0e77-48dd-8b5c-5caa300dd81f service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:22.264929 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1377/2768] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:22.397915 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa880ca-0951-4010-bd06-d943e94c4fbc None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:22.464573 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa880ca-0951-4010-bd06-d943e94c4fbc None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:22.469276 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:22.469910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:22.470195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:22.470474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] PATH_INFO: `/v3/users/ac5e15f6f6024e258dd6b1501d9677ae` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:22.471623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5e15f6f6024e258dd6b1501d9677ae)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:22.473604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:22.473753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02196579-0e77-48dd-8b5c-5caa300dd81f service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:22.475146 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-02196579-0e77-48dd-8b5c-5caa300dd81f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:22.488580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02196579-0e77-48dd-8b5c-5caa300dd81f service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:22.493609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:22.494259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:22.495066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:22.495343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] PATH_INFO: `/v3/users/3536970a18b343c6a90a6fdfe8c2463d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:22.496501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3536970a18b343c6a90a6fdfe8c2463d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:22.498399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:22.746252 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5e15f6f6024e258dd6b1501d9677ae'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:22.753200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5e15f6f6024e258dd6b1501d9677ae'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:22.753912 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5e15f6f6024e258dd6b1501d9677ae'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:22.768312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3536970a18b343c6a90a6fdfe8c2463d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:22.775254 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3536970a18b343c6a90a6fdfe8c2463d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:22.835848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5e15f6f6024e258dd6b1501d9677ae'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:22.848769 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4b5cbf9b-8f17-4476-9ff1-efb6a727816c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5e15f6f6024e258dd6b1501d9677ae'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:22.855411 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1392/2769] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:22 2022] DELETE /identity/v3/users/ac5e15f6f6024e258dd6b1501d9677ae => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:22.859899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37301647-dbb6-42de-b473-aa011b9c06c2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:22.860179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37301647-dbb6-42de-b473-aa011b9c06c2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:22.860484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37301647-dbb6-42de-b473-aa011b9c06c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:22.879778 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-37301647-dbb6-42de-b473-aa011b9c06c2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:22.883138 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-37301647-dbb6-42de-b473-aa011b9c06c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:22.899042 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3536970a18b343c6a90a6fdfe8c2463d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:22.899762 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3536970a18b343c6a90a6fdfe8c2463d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:22.901203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-aed47ba9-8b16-47c7-90ed-e3e00749cbac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3536970a18b343c6a90a6fdfe8c2463d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:22.920473 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1378/2770] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:22 2022] DELETE /identity/v3/users/3536970a18b343c6a90a6fdfe8c2463d => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:22.924663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:22.924864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c706fd-d0dc-4a45-8c0b-ed4fdbc193d8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:22.925187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c706fd-d0dc-4a45-8c0b-ed4fdbc193d8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:22.925465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c706fd-d0dc-4a45-8c0b-ed4fdbc193d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:22.938978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1393/2771] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:30:22.944817 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f4c706fd-d0dc-4a45-8c0b-ed4fdbc193d8 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:22.946101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f4c706fd-d0dc-4a45-8c0b-ed4fdbc193d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:22.949823 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37301647-dbb6-42de-b473-aa011b9c06c2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:22.953170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-37301647-dbb6-42de-b473-aa011b9c06c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:23.010182 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1379/2772] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:30:23.010577 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37301647-dbb6-42de-b473-aa011b9c06c2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:23.019918 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c706fd-d0dc-4a45-8c0b-ed4fdbc193d8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:23.065323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ef6d8-98d3-469e-a620-89d655ea6e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:23.065895 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ef6d8-98d3-469e-a620-89d655ea6e85 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:23.066196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ef6d8-98d3-469e-a620-89d655ea6e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:23.066471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ef6d8-98d3-469e-a620-89d655ea6e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:23.076173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ef6d8-98d3-469e-a620-89d655ea6e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:23.077569 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c706fd-d0dc-4a45-8c0b-ed4fdbc193d8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:23.077695 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ef6d8-98d3-469e-a620-89d655ea6e85 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:23.081660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d6f78-e347-4134-b743-8c305e0916af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:23.082261 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d6f78-e347-4134-b743-8c305e0916af service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:23.082542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d6f78-e347-4134-b743-8c305e0916af service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:23.082820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d6f78-e347-4134-b743-8c305e0916af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:23.088016 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1394/2773] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:23.093167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d6f78-e347-4134-b743-8c305e0916af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:23.094614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d6f78-e347-4134-b743-8c305e0916af service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:23.100057 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:23.105860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1380/2774] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:30:23.609146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ef6d8-98d3-469e-a620-89d655ea6e85 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:23.610581 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d63ef6d8-98d3-469e-a620-89d655ea6e85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:23.645146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ef6d8-98d3-469e-a620-89d655ea6e85 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:23.646812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d6f78-e347-4134-b743-8c305e0916af service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:23.648566 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4e8d6f78-e347-4134-b743-8c305e0916af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:23.654394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:23.657132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:23.657132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:23.657132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] PATH_INFO: `/v3/projects/87a4c37bbd8a4743905a38f6216a8d3e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:23.657132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a4c37bbd8a4743905a38f6216a8d3e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:23.658741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:23.684874 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d6f78-e347-4134-b743-8c305e0916af service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:23.696350 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:23.697051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:23.697399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:23.698411 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] PATH_INFO: `/v3/projects/5e80ceade9db42e88ba3b74f903d49f1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:23.699510 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e80ceade9db42e88ba3b74f903d49f1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:23.701369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:23.809645 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a4c37bbd8a4743905a38f6216a8d3e', 'request_id': 'req-f115b168-ad74-4038-89fa-0935aea84917'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:23.815927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a4c37bbd8a4743905a38f6216a8d3e', 'request_id': 'req-f115b168-ad74-4038-89fa-0935aea84917'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:23.841683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e80ceade9db42e88ba3b74f903d49f1', 'request_id': 'req-fd083b7f-c094-4e06-9111-83565dfbb823'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:23.847974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e80ceade9db42e88ba3b74f903d49f1', 'request_id': 'req-fd083b7f-c094-4e06-9111-83565dfbb823'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:23.853677 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e80ceade9db42e88ba3b74f903d49f1', 'request_id': 'req-fd083b7f-c094-4e06-9111-83565dfbb823'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:23.864781 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a4c37bbd8a4743905a38f6216a8d3e', 'request_id': 'req-f115b168-ad74-4038-89fa-0935aea84917'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:23.876609 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] The token cache is being invalidate because project 87a4c37bbd8a4743905a38f6216a8d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:23.877539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:23.877780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:23.879131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1395/2775] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:23 2022] DELETE /identity/v3/projects/87a4c37bbd8a4743905a38f6216a8d3e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:23.882897 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:23.884164 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:23.917999 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:23.946275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115b168-ad74-4038-89fa-0935aea84917 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:23.955430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] The token cache is being invalidate because project 5e80ceade9db42e88ba3b74f903d49f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:23.955750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:23.956434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:23.958228 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1381/2776] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:23 2022] DELETE /identity/v3/projects/5e80ceade9db42e88ba3b74f903d49f1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:23.961759 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:23.963125 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:24.005036 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:24.005669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:24.005952 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:24.006236 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] PATH_INFO: `/v3/users/3ef369de68f643a59a61204a6d3c1e6b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:24.007374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef369de68f643a59a61204a6d3c1e6b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:24.009456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:24.029530 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd083b7f-c094-4e06-9111-83565dfbb823 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:24.034357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:24.034987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:24.035267 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:24.035541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] PATH_INFO: `/v3/users/27ec1fb93cd34c51b53ee720e295b541` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:24.036743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ec1fb93cd34c51b53ee720e295b541)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:24.038683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:24.227814 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ec1fb93cd34c51b53ee720e295b541'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:24.235459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ec1fb93cd34c51b53ee720e295b541'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:24.250475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef369de68f643a59a61204a6d3c1e6b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:24.257382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef369de68f643a59a61204a6d3c1e6b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:24.258173 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef369de68f643a59a61204a6d3c1e6b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:24.320528 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ec1fb93cd34c51b53ee720e295b541'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:24.321167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ec1fb93cd34c51b53ee720e295b541'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:24.321794 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ec1fb93cd34c51b53ee720e295b541'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:24.340673 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1382/2777] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:23 2022] DELETE /identity/v3/users/27ec1fb93cd34c51b53ee720e295b541 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:24.418305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef369de68f643a59a61204a6d3c1e6b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:24.431043 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef369de68f643a59a61204a6d3c1e6b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:24.438213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1396/2778] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:23 2022] DELETE /identity/v3/users/3ef369de68f643a59a61204a6d3c1e6b => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:24.807115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:24.809772 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:24.818914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:24.895857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbec4b-1064-4222-90f9-8a6c24552d64 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:24.947728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:24.949338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:24.958678 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:24.959333 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:24.959605 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:24.959871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] PATH_INFO: `/v3/projects/7a1c3b9ad89e4272860701c7ccf2560f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:24.963904 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1c3b9ad89e4272860701c7ccf2560f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:24.966014 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.035641 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6bd1b-5f9b-4dff-81f1-445e47d68607 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.040243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.040959 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.046857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.046857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] PATH_INFO: `/v3/projects/772c1ab6f184417e925ee245bf212c69` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.046857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=772c1ab6f184417e925ee245bf212c69)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.046857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.046857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:25.161812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1c3b9ad89e4272860701c7ccf2560f', 'request_id': 'req-acdba01b-f892-4463-8652-92c763801f7c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:25.168603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1c3b9ad89e4272860701c7ccf2560f', 'request_id': 'req-acdba01b-f892-4463-8652-92c763801f7c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:25.174196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1c3b9ad89e4272860701c7ccf2560f', 'request_id': 'req-acdba01b-f892-4463-8652-92c763801f7c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:25.225676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772c1ab6f184417e925ee245bf212c69', 'request_id': 'req-19a29d2a-cff9-4320-9a0f-5baf91fab18e'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:25.232631 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772c1ab6f184417e925ee245bf212c69', 'request_id': 'req-19a29d2a-cff9-4320-9a0f-5baf91fab18e'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:25.245905 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] The token cache is being invalidate because project 7a1c3b9ad89e4272860701c7ccf2560f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:25.246201 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:25.246816 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:25.248417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1383/2779] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:24 2022] DELETE /identity/v3/projects/7a1c3b9ad89e4272860701c7ccf2560f => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:25.249184 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.250466 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:25.296406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:25.310390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772c1ab6f184417e925ee245bf212c69', 'request_id': 'req-19a29d2a-cff9-4320-9a0f-5baf91fab18e'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:25.313729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdba01b-f892-4463-8652-92c763801f7c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.323567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] The token cache is being invalidate because project 772c1ab6f184417e925ee245bf212c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:25.323862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:25.331072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-19a29d2a-cff9-4320-9a0f-5baf91fab18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:25.331072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1397/2780] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:24 2022] DELETE /identity/v3/projects/772c1ab6f184417e925ee245bf212c69 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:25.331072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7bd13-37cb-49a3-9f39-d54fc0dd24d0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.331072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7bd13-37cb-49a3-9f39-d54fc0dd24d0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.331072 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7bd13-37cb-49a3-9f39-d54fc0dd24d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.349768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7fa7bd13-37cb-49a3-9f39-d54fc0dd24d0 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:25.351215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7fa7bd13-37cb-49a3-9f39-d54fc0dd24d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:25.364884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f5ac6-2fe9-49f7-a362-344b1f0ed617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.365650 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f5ac6-2fe9-49f7-a362-344b1f0ed617 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.365945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f5ac6-2fe9-49f7-a362-344b1f0ed617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.366196 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f5ac6-2fe9-49f7-a362-344b1f0ed617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.368188 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d2f5ac6-2fe9-49f7-a362-344b1f0ed617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:25.414050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1398/2781] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:25.415360 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c5166-4818-44a9-a342-0262131ecf85 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.415648 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c5166-4818-44a9-a342-0262131ecf85 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.415921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c5166-4818-44a9-a342-0262131ecf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.433745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f5ac6-2fe9-49f7-a362-344b1f0ed617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.435210 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f5ac6-2fe9-49f7-a362-344b1f0ed617 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.437033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-978c5166-4818-44a9-a342-0262131ecf85 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:25.438228 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-978c5166-4818-44a9-a342-0262131ecf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:25.444812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1384/2782] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:25.446073 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7b3fe-1176-490d-a3ea-868780f47720 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.446357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7b3fe-1176-490d-a3ea-868780f47720 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.446632 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7b3fe-1176-490d-a3ea-868780f47720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.447033 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1399/2783] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:25.455205 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ff9e-9086-44db-8e7a-900e8a16ac2d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.457627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ff9e-9086-44db-8e7a-900e8a16ac2d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.457627 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ff9e-9086-44db-8e7a-900e8a16ac2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.468956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3ff7b3fe-1176-490d-a3ea-868780f47720 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:25.470472 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3ff7b3fe-1176-490d-a3ea-868780f47720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:25.479880 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1385/2784] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:25.481442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-cf72ff9e-9086-44db-8e7a-900e8a16ac2d None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:25.482984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cf72ff9e-9086-44db-8e7a-900e8a16ac2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:25.484884 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7b3fe-1176-490d-a3ea-868780f47720 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.492247 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1400/2785] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:25.496581 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7b3fe-1176-490d-a3ea-868780f47720 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.496727 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72ff9e-9086-44db-8e7a-900e8a16ac2d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.501864 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78851ec-90b1-4ee5-8464-3151c1f6b5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.502790 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78851ec-90b1-4ee5-8464-3151c1f6b5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.503363 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78851ec-90b1-4ee5-8464-3151c1f6b5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.504027 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78851ec-90b1-4ee5-8464-3151c1f6b5c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.504876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78851ec-90b1-4ee5-8464-3151c1f6b5c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:30:25.505471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78851ec-90b1-4ee5-8464-3151c1f6b5c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.507609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78851ec-90b1-4ee5-8464-3151c1f6b5c6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.508553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72ff9e-9086-44db-8e7a-900e8a16ac2d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.516887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6069cd7-fccb-4922-a42e-361022eddc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.517748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069cd7-fccb-4922-a42e-361022eddc46 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.518090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069cd7-fccb-4922-a42e-361022eddc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.518718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069cd7-fccb-4922-a42e-361022eddc46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.519455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6069cd7-fccb-4922-a42e-361022eddc46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:30:25.519877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6069cd7-fccb-4922-a42e-361022eddc46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.522143 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6069cd7-fccb-4922-a42e-361022eddc46 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.535915 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1386/2786] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:30:25.536486 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1401/2787] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:30:25.543459 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6069cd7-fccb-4922-a42e-361022eddc46 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.543735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78851ec-90b1-4ee5-8464-3151c1f6b5c6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.553688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78851ec-90b1-4ee5-8464-3151c1f6b5c6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.553857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6069cd7-fccb-4922-a42e-361022eddc46 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.558679 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f4ec6-0f68-4c8b-a42b-6ab0402ab509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.558877 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167057-c537-4708-9f0e-46b6748a9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.559437 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f4ec6-0f68-4c8b-a42b-6ab0402ab509 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.559549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167057-c537-4708-9f0e-46b6748a9224 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.559729 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167057-c537-4708-9f0e-46b6748a9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.559879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f4ec6-0f68-4c8b-a42b-6ab0402ab509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.560001 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167057-c537-4708-9f0e-46b6748a9224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.560307 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f4ec6-0f68-4c8b-a42b-6ab0402ab509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.560707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03167057-c537-4708-9f0e-46b6748a9224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.561071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f4ec6-0f68-4c8b-a42b-6ab0402ab509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.562611 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03167057-c537-4708-9f0e-46b6748a9224 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.563175 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f4ec6-0f68-4c8b-a42b-6ab0402ab509 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.695257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1402/2788] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:25 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:30:25.696154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167057-c537-4708-9f0e-46b6748a9224 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.702106 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1387/2789] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:25 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:25.706397 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f4ec6-0f68-4c8b-a42b-6ab0402ab509 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.766821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:25.786852 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167057-c537-4708-9f0e-46b6748a9224 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.787278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f4ec6-0f68-4c8b-a42b-6ab0402ab509 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.792676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c37572-1547-4656-843d-95aaa05ea4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.792833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27ac67-2de4-4450-a080-d7ec5eac0a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.793005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c37572-1547-4656-843d-95aaa05ea4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.793256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ac67-2de4-4450-a080-d7ec5eac0a04 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.793516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c37572-1547-4656-843d-95aaa05ea4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.793624 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ac67-2de4-4450-a080-d7ec5eac0a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.793800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ac67-2de4-4450-a080-d7ec5eac0a04 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.793914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c37572-1547-4656-843d-95aaa05ea4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.794440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27ac67-2de4-4450-a080-d7ec5eac0a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.794726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c37572-1547-4656-843d-95aaa05ea4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.796481 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27ac67-2de4-4450-a080-d7ec5eac0a04 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.796813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c37572-1547-4656-843d-95aaa05ea4f6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.809296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:25.865191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1403/2790] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:25 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:25.869836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c37572-1547-4656-843d-95aaa05ea4f6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.880295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c37572-1547-4656-843d-95aaa05ea4f6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.885751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f1121-7587-41b5-ad1e-7cc45599782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.886335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f1121-7587-41b5-ad1e-7cc45599782f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.886618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f1121-7587-41b5-ad1e-7cc45599782f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.886898 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f1121-7587-41b5-ad1e-7cc45599782f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.887546 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f1121-7587-41b5-ad1e-7cc45599782f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.889617 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f1121-7587-41b5-ad1e-7cc45599782f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.894911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1388/2791] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:25 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:30:25.903282 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27ac67-2de4-4450-a080-d7ec5eac0a04 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.905938 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1404/2792] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:30:25.909629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f1121-7587-41b5-ad1e-7cc45599782f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.914801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27ac67-2de4-4450-a080-d7ec5eac0a04 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.920000 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f1121-7587-41b5-ad1e-7cc45599782f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.924035 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed649ba-8f20-4b8a-9001-cad47fe6113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.924698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed649ba-8f20-4b8a-9001-cad47fe6113f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.924904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc26a3-e6dd-42db-8264-876138d77095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.925026 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed649ba-8f20-4b8a-9001-cad47fe6113f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.925222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed649ba-8f20-4b8a-9001-cad47fe6113f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.925702 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc26a3-e6dd-42db-8264-876138d77095 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.925880 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc26a3-e6dd-42db-8264-876138d77095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.926000 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed649ba-8f20-4b8a-9001-cad47fe6113f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.926150 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc26a3-e6dd-42db-8264-876138d77095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.927065 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc26a3-e6dd-42db-8264-876138d77095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.927572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed649ba-8f20-4b8a-9001-cad47fe6113f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.928728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc26a3-e6dd-42db-8264-876138d77095 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.940471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1389/2793] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:30:25.940821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1405/2794] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:30:25.944417 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc26a3-e6dd-42db-8264-876138d77095 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.947284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed649ba-8f20-4b8a-9001-cad47fe6113f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.956003 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc26a3-e6dd-42db-8264-876138d77095 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.959205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed649ba-8f20-4b8a-9001-cad47fe6113f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.962032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76042e1a-b898-4f4a-91c1-53a885a6af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.968305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76042e1a-b898-4f4a-91c1-53a885a6af0a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.968305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76042e1a-b898-4f4a-91c1-53a885a6af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.968305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76042e1a-b898-4f4a-91c1-53a885a6af0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.968305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76042e1a-b898-4f4a-91c1-53a885a6af0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.968714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99f013-8793-497a-853f-d372d0a7005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.968714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f013-8793-497a-853f-d372d0a7005a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.968714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f013-8793-497a-853f-d372d0a7005a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.968714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f013-8793-497a-853f-d372d0a7005a admin admin] PATH_INFO: `/v3/projects/923196f6c9844ab9b40074d62c49c736/users/f080e47c012d4a6a9f92df64d3f57db6/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:25.969066 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76042e1a-b898-4f4a-91c1-53a885a6af0a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.975707 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1406/2795] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:30:25.979840 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76042e1a-b898-4f4a-91c1-53a885a6af0a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:25.981507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99f013-8793-497a-853f-d372d0a7005a admin admin] RBAC: Authorizing `identity:create_grant(project_id=923196f6c9844ab9b40074d62c49c736, user_id=f080e47c012d4a6a9f92df64d3f57db6, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:25.984136 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99f013-8793-497a-853f-d372d0a7005a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:25.989978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76042e1a-b898-4f4a-91c1-53a885a6af0a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:25.996484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8d419-bbe3-4033-8af0-35fe00685456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:25.997442 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8d419-bbe3-4033-8af0-35fe00685456 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:25.997866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8d419-bbe3-4033-8af0-35fe00685456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:25.998250 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8d419-bbe3-4033-8af0-35fe00685456 admin admin] PATH_INFO: `/v3/projects/380c50cca23b42c3a04789f48876f972/users/bc8d3c6e17e24da18dbd3f7f408b6fb0/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.018296 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8d419-bbe3-4033-8af0-35fe00685456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380c50cca23b42c3a04789f48876f972, user_id=bc8d3c6e17e24da18dbd3f7f408b6fb0, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.021607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8d419-bbe3-4033-8af0-35fe00685456 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.036648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1390/2796] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:25 2022] PUT /identity/v3/projects/923196f6c9844ab9b40074d62c49c736/users/f080e47c012d4a6a9f92df64d3f57db6/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:26.048265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aadb04-fbe4-4279-9df9-5f8787c287cd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.048703 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aadb04-fbe4-4279-9df9-5f8787c287cd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.049207 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aadb04-fbe4-4279-9df9-5f8787c287cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.079665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c8aadb04-fbe4-4279-9df9-5f8787c287cd None None] MFA Rules not processed for user `f080e47c012d4a6a9f92df64d3f57db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:26.081259 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c8aadb04-fbe4-4279-9df9-5f8787c287cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:26.091275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1407/2797] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:25 2022] PUT /identity/v3/projects/380c50cca23b42c3a04789f48876f972/users/bc8d3c6e17e24da18dbd3f7f408b6fb0/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:26.103061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d01d-d570-4ccb-9935-cc9975572b0c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.103354 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d01d-d570-4ccb-9935-cc9975572b0c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.103659 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d01d-d570-4ccb-9935-cc9975572b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.137887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-65d6d01d-d570-4ccb-9935-cc9975572b0c None None] MFA Rules not processed for user `bc8d3c6e17e24da18dbd3f7f408b6fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:26.139192 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-65d6d01d-d570-4ccb-9935-cc9975572b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:26.163147 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1391/2798] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:26.167879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aadb04-fbe4-4279-9df9-5f8787c287cd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.216859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1408/2799] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:30:26.221534 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6d01d-d570-4ccb-9935-cc9975572b0c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.243065 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aadb04-fbe4-4279-9df9-5f8787c287cd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.290412 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6d01d-d570-4ccb-9935-cc9975572b0c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.295855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388333d-2aba-48bf-bd4a-18a68fd55f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.296499 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388333d-2aba-48bf-bd4a-18a68fd55f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.296786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388333d-2aba-48bf-bd4a-18a68fd55f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.297057 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388333d-2aba-48bf-bd4a-18a68fd55f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.297694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388333d-2aba-48bf-bd4a-18a68fd55f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.299587 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388333d-2aba-48bf-bd4a-18a68fd55f90 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.307525 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:26.310068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:26.315620 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40d98b-8c06-4bea-b4d8-a57fa51084bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.316415 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d98b-8c06-4bea-b4d8-a57fa51084bc admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.316692 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d98b-8c06-4bea-b4d8-a57fa51084bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.317072 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d98b-8c06-4bea-b4d8-a57fa51084bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.317885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40d98b-8c06-4bea-b4d8-a57fa51084bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.319839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40d98b-8c06-4bea-b4d8-a57fa51084bc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.440863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1409/2800] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:26 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:30:26.441183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1392/2801] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:26 2022] POST /identity/v3/projects => generated 379 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:26.442207 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40d98b-8c06-4bea-b4d8-a57fa51084bc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.442446 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388333d-2aba-48bf-bd4a-18a68fd55f90 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.508495 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40d98b-8c06-4bea-b4d8-a57fa51084bc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.508789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388333d-2aba-48bf-bd4a-18a68fd55f90 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.513278 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ed5d3-ed0c-4e27-833b-5457509afbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.513885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ed5d3-ed0c-4e27-833b-5457509afbec admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.514029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682a1a1-1ba4-4296-9bd7-2cfa3a82ee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.514143 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ed5d3-ed0c-4e27-833b-5457509afbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.514419 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ed5d3-ed0c-4e27-833b-5457509afbec admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.514628 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a1a1-1ba4-4296-9bd7-2cfa3a82ee69 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.514921 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a1a1-1ba4-4296-9bd7-2cfa3a82ee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.515115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ed5d3-ed0c-4e27-833b-5457509afbec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.515212 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a1a1-1ba4-4296-9bd7-2cfa3a82ee69 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.515821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682a1a1-1ba4-4296-9bd7-2cfa3a82ee69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.516987 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ed5d3-ed0c-4e27-833b-5457509afbec admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.517834 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682a1a1-1ba4-4296-9bd7-2cfa3a82ee69 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.630617 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1393/2802] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:26 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:26.634565 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ed5d3-ed0c-4e27-833b-5457509afbec admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.644132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1410/2803] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:26 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:26.647901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682a1a1-1ba4-4296-9bd7-2cfa3a82ee69 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.650241 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ed5d3-ed0c-4e27-833b-5457509afbec admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.656112 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd86d-c642-40c2-986a-ad025628a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.656879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd86d-c642-40c2-986a-ad025628a9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.657195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd86d-c642-40c2-986a-ad025628a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.658092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd86d-c642-40c2-986a-ad025628a9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.658236 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbd86d-c642-40c2-986a-ad025628a9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.659158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682a1a1-1ba4-4296-9bd7-2cfa3a82ee69 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.660032 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbd86d-c642-40c2-986a-ad025628a9ba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.665929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ac6e-f6c8-43e6-a2d8-88a3eb42d9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.670511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ac6e-f6c8-43e6-a2d8-88a3eb42d9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.670511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ac6e-f6c8-43e6-a2d8-88a3eb42d9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.670511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ac6e-f6c8-43e6-a2d8-88a3eb42d9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.670511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80ac6e-f6c8-43e6-a2d8-88a3eb42d9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.670511 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80ac6e-f6c8-43e6-a2d8-88a3eb42d9b9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.671554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1394/2804] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:26.675706 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd86d-c642-40c2-986a-ad025628a9ba admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.684396 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1411/2805] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:30:26.687686 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd86d-c642-40c2-986a-ad025628a9ba admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.690019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ac6e-f6c8-43e6-a2d8-88a3eb42d9b9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.698015 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ec406-0442-4b4b-85b6-c64381c2ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.698699 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec406-0442-4b4b-85b6-c64381c2ccf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.698981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec406-0442-4b4b-85b6-c64381c2ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.699258 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec406-0442-4b4b-85b6-c64381c2ccf7 admin admin] PATH_INFO: `/v3/projects/e98b7d82aba54c40ba08c91e99865d9e/users/22abfee545364bb48aee494674558a63/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.701275 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ac6e-f6c8-43e6-a2d8-88a3eb42d9b9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.706127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65501993-f511-4f2e-9099-f4e6584441a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.706848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501993-f511-4f2e-9099-f4e6584441a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.707131 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501993-f511-4f2e-9099-f4e6584441a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.707409 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501993-f511-4f2e-9099-f4e6584441a3 admin admin] PATH_INFO: `/v3/projects/a3d9c078e5b2452e9711ea3060a409ce/users/a9ba7ccf8d294110a4348a6c0e6541d6/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.715718 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ec406-0442-4b4b-85b6-c64381c2ccf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98b7d82aba54c40ba08c91e99865d9e, user_id=22abfee545364bb48aee494674558a63, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.718434 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ec406-0442-4b4b-85b6-c64381c2ccf7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.725733 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65501993-f511-4f2e-9099-f4e6584441a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d9c078e5b2452e9711ea3060a409ce, user_id=a9ba7ccf8d294110a4348a6c0e6541d6, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.728366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65501993-f511-4f2e-9099-f4e6584441a3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.773389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1395/2806] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:26 2022] PUT /identity/v3/projects/e98b7d82aba54c40ba08c91e99865d9e/users/22abfee545364bb48aee494674558a63/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:26.777815 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ec406-0442-4b4b-85b6-c64381c2ccf7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.798945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1412/2807] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:26 2022] PUT /identity/v3/projects/a3d9c078e5b2452e9711ea3060a409ce/users/a9ba7ccf8d294110a4348a6c0e6541d6/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:26.802786 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65501993-f511-4f2e-9099-f4e6584441a3 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.850983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ec406-0442-4b4b-85b6-c64381c2ccf7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.877850 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65501993-f511-4f2e-9099-f4e6584441a3 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.883219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bde52-b8fd-4566-8196-384aee673282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.883904 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bde52-b8fd-4566-8196-384aee673282 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.884281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bde52-b8fd-4566-8196-384aee673282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.884622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bde52-b8fd-4566-8196-384aee673282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.885401 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bde52-b8fd-4566-8196-384aee673282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.887586 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bde52-b8fd-4566-8196-384aee673282 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.898767 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1413/2808] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:30:26.903387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bde52-b8fd-4566-8196-384aee673282 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.906840 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:26.916955 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bde52-b8fd-4566-8196-384aee673282 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.921888 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f9f3a-9ec9-43d2-9894-55d507ae363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.926130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9f3a-9ec9-43d2-9894-55d507ae363c admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.926130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9f3a-9ec9-43d2-9894-55d507ae363c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.926130 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9f3a-9ec9-43d2-9894-55d507ae363c admin admin] PATH_INFO: `/v3/projects/a3d9c078e5b2452e9711ea3060a409ce/users/a9ba7ccf8d294110a4348a6c0e6541d6/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.926508 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4937-20c7-4588-bfe9-cf5202634f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:26.927121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4937-20c7-4588-bfe9-cf5202634f5d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.927404 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4937-20c7-4588-bfe9-cf5202634f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.927683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4937-20c7-4588-bfe9-cf5202634f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.928368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4937-20c7-4588-bfe9-cf5202634f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.929053 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f9f3a-9ec9-43d2-9894-55d507ae363c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d9c078e5b2452e9711ea3060a409ce, user_id=a9ba7ccf8d294110a4348a6c0e6541d6, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:26.930051 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4937-20c7-4588-bfe9-cf5202634f5d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.931667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f9f3a-9ec9-43d2-9894-55d507ae363c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:26.941669 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1396/2809] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:30:26.942559 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1414/2810] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:26 2022] PUT /identity/v3/projects/a3d9c078e5b2452e9711ea3060a409ce/users/a9ba7ccf8d294110a4348a6c0e6541d6/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:26.945619 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4937-20c7-4588-bfe9-cf5202634f5d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:26.953159 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4a485-1546-4672-ac42-44f1ad41609d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:26.953525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4a485-1546-4672-ac42-44f1ad41609d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:26.953732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4a485-1546-4672-ac42-44f1ad41609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:26.956574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4937-20c7-4588-bfe9-cf5202634f5d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:26.983391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-87d4a485-1546-4672-ac42-44f1ad41609d None None] MFA Rules not processed for user `a9ba7ccf8d294110a4348a6c0e6541d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:26.984596 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-87d4a485-1546-4672-ac42-44f1ad41609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:26.998653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:27.030345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace5eef-a0b4-487d-b588-5e1dc80eef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:27.031308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace5eef-a0b4-487d-b588-5e1dc80eef4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:27.031585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace5eef-a0b4-487d-b588-5e1dc80eef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:27.031860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace5eef-a0b4-487d-b588-5e1dc80eef4d admin admin] PATH_INFO: `/v3/projects/e98b7d82aba54c40ba08c91e99865d9e/users/22abfee545364bb48aee494674558a63/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:27.034076 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace5eef-a0b4-487d-b588-5e1dc80eef4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98b7d82aba54c40ba08c91e99865d9e, user_id=22abfee545364bb48aee494674558a63, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:27.036760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace5eef-a0b4-487d-b588-5e1dc80eef4d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:27.050522 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1397/2811] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:26 2022] PUT /identity/v3/projects/e98b7d82aba54c40ba08c91e99865d9e/users/22abfee545364bb48aee494674558a63/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:27.061009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558425f0-3194-4aa9-85f3-db5e3f11032a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:27.061303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558425f0-3194-4aa9-85f3-db5e3f11032a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:27.061586 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558425f0-3194-4aa9-85f3-db5e3f11032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:27.069070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1415/2812] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:30:27.081644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4a485-1546-4672-ac42-44f1ad41609d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:27.083088 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-87d4a485-1546-4672-ac42-44f1ad41609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:27.096951 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-558425f0-3194-4aa9-85f3-db5e3f11032a None None] MFA Rules not processed for user `22abfee545364bb48aee494674558a63`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:27.098118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-558425f0-3194-4aa9-85f3-db5e3f11032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:27.158563 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4a485-1546-4672-ac42-44f1ad41609d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:27.181156 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1398/2813] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:27.191474 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558425f0-3194-4aa9-85f3-db5e3f11032a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:27.192954 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-558425f0-3194-4aa9-85f3-db5e3f11032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:27.219819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd04b-dae2-44dd-89f3-0ae8d3be359d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:27.220471 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd04b-dae2-44dd-89f3-0ae8d3be359d service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:27.221485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd04b-dae2-44dd-89f3-0ae8d3be359d service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:27.221485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd04b-dae2-44dd-89f3-0ae8d3be359d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:27.261541 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558425f0-3194-4aa9-85f3-db5e3f11032a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:27.265748 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e6293-3017-497e-b8b0-39da1b8bdf7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:27.266575 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e6293-3017-497e-b8b0-39da1b8bdf7c service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:27.266922 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e6293-3017-497e-b8b0-39da1b8bdf7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:27.267273 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e6293-3017-497e-b8b0-39da1b8bdf7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:27.278100 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e6293-3017-497e-b8b0-39da1b8bdf7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:27.279546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e6293-3017-497e-b8b0-39da1b8bdf7c service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:27.284699 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dd04b-dae2-44dd-89f3-0ae8d3be359d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:27.285694 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:27.286152 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dd04b-dae2-44dd-89f3-0ae8d3be359d service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:27.294056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1399/2814] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:30:27.296484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1416/2815] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:30:28.660972 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e6293-3017-497e-b8b0-39da1b8bdf7c service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:28.745611 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e6293-3017-497e-b8b0-39da1b8bdf7c service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:28.750404 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:28.751060 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:28.751335 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:28.751606 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] PATH_INFO: `/v3/users/bc8d3c6e17e24da18dbd3f7f408b6fb0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:28.752770 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8d3c6e17e24da18dbd3f7f408b6fb0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:28.754658 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:29.000306 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8d3c6e17e24da18dbd3f7f408b6fb0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:29.000306 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8d3c6e17e24da18dbd3f7f408b6fb0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:29.105344 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8d3c6e17e24da18dbd3f7f408b6fb0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:29.106007 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8d3c6e17e24da18dbd3f7f408b6fb0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:29.106628 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8d3c6e17e24da18dbd3f7f408b6fb0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:29.129860 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1400/2816] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:28 2022] DELETE /identity/v3/users/bc8d3c6e17e24da18dbd3f7f408b6fb0 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:29.136691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abfe61-7142-4c13-bc04-f731d43349e2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:29.136691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abfe61-7142-4c13-bc04-f731d43349e2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:29.136691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abfe61-7142-4c13-bc04-f731d43349e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:29.163837 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-12abfe61-7142-4c13-bc04-f731d43349e2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:29.175414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-12abfe61-7142-4c13-bc04-f731d43349e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:29.185498 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:29.229697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1417/2817] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:29.240174 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:29.241974 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:29.304959 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71137f-3cae-42b2-80b8-2beb21199585 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:29.308634 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c72d45-fa5d-473e-b028-fe0fea7219c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:29.309263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c72d45-fa5d-473e-b028-fe0fea7219c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:29.309546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c72d45-fa5d-473e-b028-fe0fea7219c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:29.309814 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c72d45-fa5d-473e-b028-fe0fea7219c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:29.319251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c72d45-fa5d-473e-b028-fe0fea7219c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:29.320758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c72d45-fa5d-473e-b028-fe0fea7219c2 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:29.331206 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1401/2818] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:29.820124 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abfe61-7142-4c13-bc04-f731d43349e2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:29.821948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-12abfe61-7142-4c13-bc04-f731d43349e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:29.840233 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abfe61-7142-4c13-bc04-f731d43349e2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:29.844981 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:29.845891 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:29.846322 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:29.846610 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] PATH_INFO: `/v3/projects/380c50cca23b42c3a04789f48876f972` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:29.847831 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=380c50cca23b42c3a04789f48876f972)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:29.850136 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:29.976700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380c50cca23b42c3a04789f48876f972', 'request_id': 'req-bf0e5eb6-b340-4ad3-9556-013062532ab8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:29.985056 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380c50cca23b42c3a04789f48876f972', 'request_id': 'req-bf0e5eb6-b340-4ad3-9556-013062532ab8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:30.065295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380c50cca23b42c3a04789f48876f972', 'request_id': 'req-bf0e5eb6-b340-4ad3-9556-013062532ab8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:30.079656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] The token cache is being invalidate because project 380c50cca23b42c3a04789f48876f972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:30.079944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:30.080698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:30.082195 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1418/2819] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:29 2022] DELETE /identity/v3/projects/380c50cca23b42c3a04789f48876f972 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:30.086981 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c72d45-fa5d-473e-b028-fe0fea7219c2 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:30.104729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c72d45-fa5d-473e-b028-fe0fea7219c2 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:30.125271 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:30.173742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:30.174457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:30.174457 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:30.174662 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] PATH_INFO: `/v3/users/22abfee545364bb48aee494674558a63` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:30.175806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22abfee545364bb48aee494674558a63)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:30.177753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:30.242379 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:30.243950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:30.310220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5eb6-b340-4ad3-9556-013062532ab8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:30.310220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3928b78-21ef-4982-bd7e-004bbaffa015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:30.310220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928b78-21ef-4982-bd7e-004bbaffa015 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:30.310220 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928b78-21ef-4982-bd7e-004bbaffa015 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:30.310688 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928b78-21ef-4982-bd7e-004bbaffa015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:30.310835 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c3928b78-21ef-4982-bd7e-004bbaffa015 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:30.382175 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:30.386081 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3928b78-21ef-4982-bd7e-004bbaffa015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:30.387527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3928b78-21ef-4982-bd7e-004bbaffa015 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:30.401308 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1419/2820] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:30:30.440567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22abfee545364bb48aee494674558a63'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:30.455809 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22abfee545364bb48aee494674558a63'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:30.569590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22abfee545364bb48aee494674558a63'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:30.569590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22abfee545364bb48aee494674558a63'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:30.569590 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b59ab21d-59e6-46f8-94c4-6c7a29e433e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22abfee545364bb48aee494674558a63'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:30.593543 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1402/2821] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:30 2022] DELETE /identity/v3/users/22abfee545364bb48aee494674558a63 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:31.122622 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3928b78-21ef-4982-bd7e-004bbaffa015 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:31.124445 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c3928b78-21ef-4982-bd7e-004bbaffa015 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:31.151393 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3928b78-21ef-4982-bd7e-004bbaffa015 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:31.273982 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:31.274618 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:31.275035 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:31.275383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] PATH_INFO: `/v3/projects/e98b7d82aba54c40ba08c91e99865d9e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:31.276754 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98b7d82aba54c40ba08c91e99865d9e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:31.278913 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:31.428041 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98b7d82aba54c40ba08c91e99865d9e', 'request_id': 'req-3ebaba4e-2624-4324-a0bb-91f31f66741c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:31.441087 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98b7d82aba54c40ba08c91e99865d9e', 'request_id': 'req-3ebaba4e-2624-4324-a0bb-91f31f66741c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:31.544662 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98b7d82aba54c40ba08c91e99865d9e', 'request_id': 'req-3ebaba4e-2624-4324-a0bb-91f31f66741c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:31.566714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] The token cache is being invalidate because project e98b7d82aba54c40ba08c91e99865d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:31.567191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:31.568776 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3ebaba4e-2624-4324-a0bb-91f31f66741c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:31.573454 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1420/2822] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:31 2022] DELETE /identity/v3/projects/e98b7d82aba54c40ba08c91e99865d9e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:31.578571 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a878c3-61e2-449e-8197-dac7058cdd80 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:31.582545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a878c3-61e2-449e-8197-dac7058cdd80 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:31.582545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a878c3-61e2-449e-8197-dac7058cdd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:31.606570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b5a878c3-61e2-449e-8197-dac7058cdd80 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:31.612942 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b5a878c3-61e2-449e-8197-dac7058cdd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:31.734195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1403/2823] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:31.734855 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c6871-a6b3-40fa-9cf5-7f8aa607055c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:31.735142 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c6871-a6b3-40fa-9cf5-7f8aa607055c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:31.735419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c6871-a6b3-40fa-9cf5-7f8aa607055c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:31.761634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-201c6871-a6b3-40fa-9cf5-7f8aa607055c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:31.764576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-201c6871-a6b3-40fa-9cf5-7f8aa607055c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:31.792713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1421/2824] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:31.794173 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a878c3-61e2-449e-8197-dac7058cdd80 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:31.809194 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a878c3-61e2-449e-8197-dac7058cdd80 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:31.815231 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33b35e-8ccc-446a-85ed-54d40952246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:31.816193 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33b35e-8ccc-446a-85ed-54d40952246e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:31.816711 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33b35e-8ccc-446a-85ed-54d40952246e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:31.817165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33b35e-8ccc-446a-85ed-54d40952246e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:31.818493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33b35e-8ccc-446a-85ed-54d40952246e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:30:31.819115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33b35e-8ccc-446a-85ed-54d40952246e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:31.821251 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33b35e-8ccc-446a-85ed-54d40952246e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:31.840274 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1404/2825] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:30:31.847440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c6871-a6b3-40fa-9cf5-7f8aa607055c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:31.854557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c6871-a6b3-40fa-9cf5-7f8aa607055c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:31.862135 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe390f-d9b3-45cc-a57f-4e44853f98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:31.863330 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe390f-d9b3-45cc-a57f-4e44853f98ca admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:31.863808 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe390f-d9b3-45cc-a57f-4e44853f98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:31.864321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe390f-d9b3-45cc-a57f-4e44853f98ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:31.865170 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe390f-d9b3-45cc-a57f-4e44853f98ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:31.867540 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe390f-d9b3-45cc-a57f-4e44853f98ca admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:32.012301 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1422/2826] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:31 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:32.016018 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33b35e-8ccc-446a-85ed-54d40952246e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:32.028547 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33b35e-8ccc-446a-85ed-54d40952246e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:32.061960 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:32.103164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b60e1-ea87-4249-88f2-072a6d9e6a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:32.103610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b60e1-ea87-4249-88f2-072a6d9e6a8d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:32.104152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b60e1-ea87-4249-88f2-072a6d9e6a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:32.104549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b60e1-ea87-4249-88f2-072a6d9e6a8d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:32.105208 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b60e1-ea87-4249-88f2-072a6d9e6a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:32.107134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b60e1-ea87-4249-88f2-072a6d9e6a8d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:32.205048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1405/2827] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:32 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:32.209366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe390f-d9b3-45cc-a57f-4e44853f98ca admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:32.220475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe390f-d9b3-45cc-a57f-4e44853f98ca admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:32.227970 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3a3b-952b-466a-bb6b-2ce732b3c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:32.228751 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3a3b-952b-466a-bb6b-2ce732b3c560 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:32.229032 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3a3b-952b-466a-bb6b-2ce732b3c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:32.229326 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3a3b-952b-466a-bb6b-2ce732b3c560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:32.229978 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3a3b-952b-466a-bb6b-2ce732b3c560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:32.233377 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3a3b-952b-466a-bb6b-2ce732b3c560 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:32.246127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1423/2828] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:30:32.250113 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b60e1-ea87-4249-88f2-072a6d9e6a8d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:32.264743 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b60e1-ea87-4249-88f2-072a6d9e6a8d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:32.270643 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846acfb-7f9a-40b9-adc7-1be9dc3c2762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:32.274370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846acfb-7f9a-40b9-adc7-1be9dc3c2762 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:32.274370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846acfb-7f9a-40b9-adc7-1be9dc3c2762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:32.274370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846acfb-7f9a-40b9-adc7-1be9dc3c2762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:32.274370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846acfb-7f9a-40b9-adc7-1be9dc3c2762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:32.274370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846acfb-7f9a-40b9-adc7-1be9dc3c2762 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:32.284746 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1406/2829] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:32.288942 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3a3b-952b-466a-bb6b-2ce732b3c560 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:32.301422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3a3b-952b-466a-bb6b-2ce732b3c560 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:32.308165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1ac61-9974-451f-9de3-cd851f72aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:32.308947 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1ac61-9974-451f-9de3-cd851f72aad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:32.309231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1ac61-9974-451f-9de3-cd851f72aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:32.310697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1ac61-9974-451f-9de3-cd851f72aad4 admin admin] PATH_INFO: `/v3/projects/d46e0cdf857146f687fca0a586b48816/users/fa2fe2c3d34041da93d3d55be83e82f0/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:32.325487 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1ac61-9974-451f-9de3-cd851f72aad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46e0cdf857146f687fca0a586b48816, user_id=fa2fe2c3d34041da93d3d55be83e82f0, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:32.330712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1ac61-9974-451f-9de3-cd851f72aad4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:32.414213 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1424/2830] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:32 2022] PUT /identity/v3/projects/d46e0cdf857146f687fca0a586b48816/users/fa2fe2c3d34041da93d3d55be83e82f0/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:32.430153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d61c4-44d2-481f-abfe-2000a2c2cafc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:32.430153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d61c4-44d2-481f-abfe-2000a2c2cafc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:32.430153 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d61c4-44d2-481f-abfe-2000a2c2cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:32.461830 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-907d61c4-44d2-481f-abfe-2000a2c2cafc None None] MFA Rules not processed for user `fa2fe2c3d34041da93d3d55be83e82f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:32.463184 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-907d61c4-44d2-481f-abfe-2000a2c2cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:32.533443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1407/2831] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:30:32.538029 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1ac61-9974-451f-9de3-cd851f72aad4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:32.566819 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:32.605025 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1ac61-9974-451f-9de3-cd851f72aad4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:32.609726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade2762-2999-4b25-90e5-85f161a4ffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:32.610338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade2762-2999-4b25-90e5-85f161a4ffea admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:32.610616 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade2762-2999-4b25-90e5-85f161a4ffea admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:32.610892 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade2762-2999-4b25-90e5-85f161a4ffea admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:32.611558 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade2762-2999-4b25-90e5-85f161a4ffea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:32.613444 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade2762-2999-4b25-90e5-85f161a4ffea admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:32.718291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1425/2832] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:32 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:32.722375 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d61c4-44d2-481f-abfe-2000a2c2cafc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:32.734444 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d61c4-44d2-481f-abfe-2000a2c2cafc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:32.793885 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a220121-7cec-492b-9a4e-0ef1dbb3f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:32.794501 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a220121-7cec-492b-9a4e-0ef1dbb3f5ab admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:32.794778 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a220121-7cec-492b-9a4e-0ef1dbb3f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:32.795067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a220121-7cec-492b-9a4e-0ef1dbb3f5ab admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:32.795714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a220121-7cec-492b-9a4e-0ef1dbb3f5ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:32.797683 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a220121-7cec-492b-9a4e-0ef1dbb3f5ab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:32.876036 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1408/2833] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:32 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:32.880075 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade2762-2999-4b25-90e5-85f161a4ffea admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:32.890944 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade2762-2999-4b25-90e5-85f161a4ffea admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:32.896646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434fa92-ebdd-4658-897a-5eee0c491b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:32.897394 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434fa92-ebdd-4658-897a-5eee0c491b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:32.897682 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434fa92-ebdd-4658-897a-5eee0c491b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:32.905687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434fa92-ebdd-4658-897a-5eee0c491b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:32.905687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434fa92-ebdd-4658-897a-5eee0c491b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:32.905687 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434fa92-ebdd-4658-897a-5eee0c491b2f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:32.911555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1426/2834] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:32.915847 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a220121-7cec-492b-9a4e-0ef1dbb3f5ab admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:32.926903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a220121-7cec-492b-9a4e-0ef1dbb3f5ab admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:32.933814 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7409e0-5737-445a-8bd9-c75bd026f4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:32.936475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7409e0-5737-445a-8bd9-c75bd026f4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:32.936475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7409e0-5737-445a-8bd9-c75bd026f4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:32.936475 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7409e0-5737-445a-8bd9-c75bd026f4b9 admin admin] PATH_INFO: `/v3/projects/67303c9c5c4c4ad5b0d387091f7023c0/users/8c7a5956dcf844279a047087e0906aaf/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:32.951198 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7409e0-5737-445a-8bd9-c75bd026f4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67303c9c5c4c4ad5b0d387091f7023c0, user_id=8c7a5956dcf844279a047087e0906aaf, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:32.953861 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7409e0-5737-445a-8bd9-c75bd026f4b9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:33.047867 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1409/2835] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:32 2022] PUT /identity/v3/projects/67303c9c5c4c4ad5b0d387091f7023c0/users/8c7a5956dcf844279a047087e0906aaf/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:33.051935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434fa92-ebdd-4658-897a-5eee0c491b2f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:33.062474 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434fa92-ebdd-4658-897a-5eee0c491b2f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:33.121172 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca9a19-0ad5-414c-b35d-336af2d5c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:33.121787 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca9a19-0ad5-414c-b35d-336af2d5c4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:33.122068 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca9a19-0ad5-414c-b35d-336af2d5c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:33.122366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca9a19-0ad5-414c-b35d-336af2d5c4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:33.123022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca9a19-0ad5-414c-b35d-336af2d5c4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:33.124670 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca9a19-0ad5-414c-b35d-336af2d5c4fe admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:33.135294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1427/2836] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:33.139399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7409e0-5737-445a-8bd9-c75bd026f4b9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:33.144962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:33.151056 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7409e0-5737-445a-8bd9-c75bd026f4b9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:33.155761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50feaf-5117-479b-aa7d-2824c2e25fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:33.164744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50feaf-5117-479b-aa7d-2824c2e25fad admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:33.164744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50feaf-5117-479b-aa7d-2824c2e25fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:33.164744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50feaf-5117-479b-aa7d-2824c2e25fad admin admin] PATH_INFO: `/v3/projects/67303c9c5c4c4ad5b0d387091f7023c0/users/8c7a5956dcf844279a047087e0906aaf/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:33.164744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50feaf-5117-479b-aa7d-2824c2e25fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=67303c9c5c4c4ad5b0d387091f7023c0, user_id=8c7a5956dcf844279a047087e0906aaf, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:33.164744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50feaf-5117-479b-aa7d-2824c2e25fad admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:33.172163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1410/2837] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:33 2022] PUT /identity/v3/projects/67303c9c5c4c4ad5b0d387091f7023c0/users/8c7a5956dcf844279a047087e0906aaf/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:33.182573 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174fce-4006-49b9-97fb-11b5ac49f03c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:33.183002 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174fce-4006-49b9-97fb-11b5ac49f03c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:33.183282 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174fce-4006-49b9-97fb-11b5ac49f03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:33.213621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a8174fce-4006-49b9-97fb-11b5ac49f03c None None] MFA Rules not processed for user `8c7a5956dcf844279a047087e0906aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:33.214832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a8174fce-4006-49b9-97fb-11b5ac49f03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:33.283273 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1428/2838] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:33.295950 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50feaf-5117-479b-aa7d-2824c2e25fad admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:33.297702 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ec50feaf-5117-479b-aa7d-2824c2e25fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:33.358092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50feaf-5117-479b-aa7d-2824c2e25fad admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:33.361786 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139712-6d99-491c-873c-e54f4b5baa4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:33.362420 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139712-6d99-491c-873c-e54f4b5baa4f service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:33.362698 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139712-6d99-491c-873c-e54f4b5baa4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:33.362968 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139712-6d99-491c-873c-e54f4b5baa4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:33.373215 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c139712-6d99-491c-873c-e54f4b5baa4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:33.374603 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c139712-6d99-491c-873c-e54f4b5baa4f service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:33.384614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1411/2839] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:33.537928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8174fce-4006-49b9-97fb-11b5ac49f03c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:33.539424 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a8174fce-4006-49b9-97fb-11b5ac49f03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:33.560141 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8174fce-4006-49b9-97fb-11b5ac49f03c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:33.562862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058e057-093a-4485-8632-3248daf31240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:33.563516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058e057-093a-4485-8632-3248daf31240 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:33.563753 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058e057-093a-4485-8632-3248daf31240 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:33.564071 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058e057-093a-4485-8632-3248daf31240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:33.578576 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:33.636668 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058e057-093a-4485-8632-3248daf31240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:33.638673 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058e057-093a-4485-8632-3248daf31240 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:33.651860 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1429/2840] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:34.286292 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139712-6d99-491c-873c-e54f4b5baa4f service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:34.350609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139712-6d99-491c-873c-e54f4b5baa4f service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:34.401044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:34.401044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:34.401044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:34.401044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] PATH_INFO: `/v3/users/fa2fe2c3d34041da93d3d55be83e82f0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:34.402232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2fe2c3d34041da93d3d55be83e82f0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:34.402232 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:34.785848 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2fe2c3d34041da93d3d55be83e82f0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:34.793063 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2fe2c3d34041da93d3d55be83e82f0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:34.904604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2fe2c3d34041da93d3d55be83e82f0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:34.905296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2fe2c3d34041da93d3d55be83e82f0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:34.905965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2fe2c3d34041da93d3d55be83e82f0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:34.927482 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1412/2841] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:34 2022] DELETE /identity/v3/users/fa2fe2c3d34041da93d3d55be83e82f0 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:34.932885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215ebb-8088-44db-a033-1c1eb043fdd2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:34.933626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215ebb-8088-44db-a033-1c1eb043fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:34.933918 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215ebb-8088-44db-a033-1c1eb043fdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:34.960984 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7f215ebb-8088-44db-a033-1c1eb043fdd2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:34.962200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7f215ebb-8088-44db-a033-1c1eb043fdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:34.964226 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:34.966029 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:34.982009 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:35.030920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1430/2842] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:35.043049 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd894b44-0f80-4581-b881-230174fde60d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:35.043696 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f215ebb-8088-44db-a033-1c1eb043fdd2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:35.045343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7f215ebb-8088-44db-a033-1c1eb043fdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:35.048513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:35.049187 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:35.049471 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:35.049745 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] PATH_INFO: `/v3/users/f080e47c012d4a6a9f92df64d3f57db6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:35.050983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f080e47c012d4a6a9f92df64d3f57db6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:35.052941 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:35.105466 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f215ebb-8088-44db-a033-1c1eb043fdd2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:35.109243 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9387643-a8a3-44b1-9c34-938fd4892870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:35.109856 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9387643-a8a3-44b1-9c34-938fd4892870 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:35.110133 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9387643-a8a3-44b1-9c34-938fd4892870 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:35.110406 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9387643-a8a3-44b1-9c34-938fd4892870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:35.120833 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9387643-a8a3-44b1-9c34-938fd4892870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:35.122262 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9387643-a8a3-44b1-9c34-938fd4892870 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:35.132874 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1431/2843] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:35.295654 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f080e47c012d4a6a9f92df64d3f57db6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:35.304432 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f080e47c012d4a6a9f92df64d3f57db6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:35.378729 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f080e47c012d4a6a9f92df64d3f57db6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:35.379398 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f080e47c012d4a6a9f92df64d3f57db6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:35.380150 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f080e47c012d4a6a9f92df64d3f57db6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:35.402863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1413/2844] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:34 2022] DELETE /identity/v3/users/f080e47c012d4a6a9f92df64d3f57db6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:35.407624 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d20139-c18f-428d-ac9c-baaa7eb72e95 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:35.407907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d20139-c18f-428d-ac9c-baaa7eb72e95 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:35.408179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d20139-c18f-428d-ac9c-baaa7eb72e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:35.430387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d2d20139-c18f-428d-ac9c-baaa7eb72e95 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:35.434343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d2d20139-c18f-428d-ac9c-baaa7eb72e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:35.495379 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:35.503869 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1432/2845] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:35.513899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:35.515355 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:35.576800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895401a5-3f95-476f-9c56-a97cc1e00628 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:35.580500 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bed2c-c8ad-48ac-8365-e166004294e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:35.581111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bed2c-c8ad-48ac-8365-e166004294e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:35.581389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bed2c-c8ad-48ac-8365-e166004294e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:35.581721 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bed2c-c8ad-48ac-8365-e166004294e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:35.597748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d20139-c18f-428d-ac9c-baaa7eb72e95 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:35.597748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d2d20139-c18f-428d-ac9c-baaa7eb72e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:35.597978 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bed2c-c8ad-48ac-8365-e166004294e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:35.597978 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bed2c-c8ad-48ac-8365-e166004294e4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:35.610621 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d20139-c18f-428d-ac9c-baaa7eb72e95 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:35.619688 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1414/2846] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:35.620166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:35.621005 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:35.621289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:35.622108 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] PATH_INFO: `/v3/projects/d46e0cdf857146f687fca0a586b48816` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:35.623414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46e0cdf857146f687fca0a586b48816)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:35.625828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:35.773854 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46e0cdf857146f687fca0a586b48816', 'request_id': 'req-db914e97-9ed6-4071-b15e-65d308084fff'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:35.780791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46e0cdf857146f687fca0a586b48816', 'request_id': 'req-db914e97-9ed6-4071-b15e-65d308084fff'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:35.871748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46e0cdf857146f687fca0a586b48816', 'request_id': 'req-db914e97-9ed6-4071-b15e-65d308084fff'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:35.890329 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] The token cache is being invalidate because project d46e0cdf857146f687fca0a586b48816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:35.890639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:35.892691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:35.897782 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1433/2847] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:35 2022] DELETE /identity/v3/projects/d46e0cdf857146f687fca0a586b48816 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:35.901470 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bed2c-c8ad-48ac-8365-e166004294e4 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:35.913128 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bed2c-c8ad-48ac-8365-e166004294e4 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:35.963862 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:35.994842 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:35.995496 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:35.995774 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:35.996352 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] PATH_INFO: `/v3/users/8c7a5956dcf844279a047087e0906aaf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:35.997765 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7a5956dcf844279a047087e0906aaf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:35.999919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:36.110882 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:36.112654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:36.132597 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914e97-9ed6-4071-b15e-65d308084fff admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:36.139706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:36.140883 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:36.141234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:36.141478 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] PATH_INFO: `/v3/projects/923196f6c9844ab9b40074d62c49c736` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:36.142760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=923196f6c9844ab9b40074d62c49c736)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:36.144698 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:36.280498 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7a5956dcf844279a047087e0906aaf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.285849 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923196f6c9844ab9b40074d62c49c736', 'request_id': 'req-b8e04bd5-1c91-444f-b472-bf4553fafe8a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.287704 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7a5956dcf844279a047087e0906aaf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.293073 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923196f6c9844ab9b40074d62c49c736', 'request_id': 'req-b8e04bd5-1c91-444f-b472-bf4553fafe8a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.390138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7a5956dcf844279a047087e0906aaf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.390841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7a5956dcf844279a047087e0906aaf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.391455 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7a5956dcf844279a047087e0906aaf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.410542 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1415/2848] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:35 2022] DELETE /identity/v3/users/8c7a5956dcf844279a047087e0906aaf => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:36.464612 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923196f6c9844ab9b40074d62c49c736', 'request_id': 'req-b8e04bd5-1c91-444f-b472-bf4553fafe8a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.479034 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] The token cache is being invalidate because project 923196f6c9844ab9b40074d62c49c736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:36.479726 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.480658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.485525 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1434/2849] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:36 2022] DELETE /identity/v3/projects/923196f6c9844ab9b40074d62c49c736 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:36.486833 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:36.488435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:36.562456 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ccee1-a15b-40dd-92ae-16b4f913f0c7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:36.567374 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:36.569580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:36.569580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:36.569580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] PATH_INFO: `/v3/users/a9ba7ccf8d294110a4348a6c0e6541d6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:36.569899 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ba7ccf8d294110a4348a6c0e6541d6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:36.571706 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:36.778609 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ba7ccf8d294110a4348a6c0e6541d6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.787742 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:36.791540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ba7ccf8d294110a4348a6c0e6541d6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.853830 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:36.855307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:36.869923 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ba7ccf8d294110a4348a6c0e6541d6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.872994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ba7ccf8d294110a4348a6c0e6541d6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.872994 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ba7ccf8d294110a4348a6c0e6541d6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:36.898635 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1416/2850] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:36 2022] DELETE /identity/v3/users/a9ba7ccf8d294110a4348a6c0e6541d6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:36.937473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e04bd5-1c91-444f-b472-bf4553fafe8a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:36.949567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:37.001797 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:37.002595 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:37.002950 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:37.003291 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] PATH_INFO: `/v3/projects/67303c9c5c4c4ad5b0d387091f7023c0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:37.004584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] RBAC: Authorizing `identity:delete_project(project_id=67303c9c5c4c4ad5b0d387091f7023c0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:37.006902 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:37.122320 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67303c9c5c4c4ad5b0d387091f7023c0', 'request_id': 'req-248a0e7c-8354-4748-85e1-6a504b82647c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:37.130901 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67303c9c5c4c4ad5b0d387091f7023c0', 'request_id': 'req-248a0e7c-8354-4748-85e1-6a504b82647c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:37.213004 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67303c9c5c4c4ad5b0d387091f7023c0', 'request_id': 'req-248a0e7c-8354-4748-85e1-6a504b82647c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:37.224453 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] The token cache is being invalidate because project 67303c9c5c4c4ad5b0d387091f7023c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:37.224753 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:37.225509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-248a0e7c-8354-4748-85e1-6a504b82647c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:37.227268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1435/2851] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:36 2022] DELETE /identity/v3/projects/67303c9c5c4c4ad5b0d387091f7023c0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:37.320594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:37.323127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:37.346195 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272108d6-0f96-482e-abfa-707dd531b4fe admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:37.430343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:37.433823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:37.433823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:37.433823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] PATH_INFO: `/v3/projects/a3d9c078e5b2452e9711ea3060a409ce` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:37.433823 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d9c078e5b2452e9711ea3060a409ce)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:37.435671 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:37.573973 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d9c078e5b2452e9711ea3060a409ce', 'request_id': 'req-275f66a4-e5e7-465a-9931-e3cb2e43157a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:37.580317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d9c078e5b2452e9711ea3060a409ce', 'request_id': 'req-275f66a4-e5e7-465a-9931-e3cb2e43157a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:37.586330 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d9c078e5b2452e9711ea3060a409ce', 'request_id': 'req-275f66a4-e5e7-465a-9931-e3cb2e43157a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:37.657573 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] The token cache is being invalidate because project a3d9c078e5b2452e9711ea3060a409ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:37.657859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:37.658488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-275f66a4-e5e7-465a-9931-e3cb2e43157a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:37.663238 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1417/2852] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:37 2022] DELETE /identity/v3/projects/a3d9c078e5b2452e9711ea3060a409ce => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:37.664969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e95f-69c2-464c-bf59-fc3bca2a67f2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:37.665254 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e95f-69c2-464c-bf59-fc3bca2a67f2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:37.665531 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150e95f-69c2-464c-bf59-fc3bca2a67f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:37.687358 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7150e95f-69c2-464c-bf59-fc3bca2a67f2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:37.688490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7150e95f-69c2-464c-bf59-fc3bca2a67f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:37.748176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1436/2853] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:37.755853 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6ad2-5bf6-48f8-83bd-4fc7d885d0d9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:37.756134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6ad2-5bf6-48f8-83bd-4fc7d885d0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:37.756443 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6ad2-5bf6-48f8-83bd-4fc7d885d0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:37.779096 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7e1b6ad2-5bf6-48f8-83bd-4fc7d885d0d9 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:37.780338 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7e1b6ad2-5bf6-48f8-83bd-4fc7d885d0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:37.788520 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1418/2854] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:37.793371 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150e95f-69c2-464c-bf59-fc3bca2a67f2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:37.803307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150e95f-69c2-464c-bf59-fc3bca2a67f2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:37.808572 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24853e78-dad7-4e13-b33f-7f9e75c39d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:37.809169 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24853e78-dad7-4e13-b33f-7f9e75c39d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:37.809443 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24853e78-dad7-4e13-b33f-7f9e75c39d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:37.809713 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24853e78-dad7-4e13-b33f-7f9e75c39d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:37.810353 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24853e78-dad7-4e13-b33f-7f9e75c39d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:30:37.810652 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24853e78-dad7-4e13-b33f-7f9e75c39d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:37.812242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24853e78-dad7-4e13-b33f-7f9e75c39d67 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:37.824242 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1437/2855] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:30:37.828429 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6ad2-5bf6-48f8-83bd-4fc7d885d0d9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:37.837709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6ad2-5bf6-48f8-83bd-4fc7d885d0d9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:37.842459 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa26b1-f74e-44a4-a53b-5987861f94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:37.843048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa26b1-f74e-44a4-a53b-5987861f94c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:37.843327 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa26b1-f74e-44a4-a53b-5987861f94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:37.843602 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa26b1-f74e-44a4-a53b-5987861f94c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:37.844247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa26b1-f74e-44a4-a53b-5987861f94c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:37.846135 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa26b1-f74e-44a4-a53b-5987861f94c2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:37.973793 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1419/2856] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:37 2022] POST /identity/v3/projects => generated 393 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:30:37.977816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24853e78-dad7-4e13-b33f-7f9e75c39d67 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:37.988701 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24853e78-dad7-4e13-b33f-7f9e75c39d67 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:38.019594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:38.050658 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc36ab6-2625-4717-9085-e7cb70f21312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:38.051376 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc36ab6-2625-4717-9085-e7cb70f21312 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:38.051712 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc36ab6-2625-4717-9085-e7cb70f21312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:38.051993 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc36ab6-2625-4717-9085-e7cb70f21312 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:38.052654 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc36ab6-2625-4717-9085-e7cb70f21312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:38.054547 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc36ab6-2625-4717-9085-e7cb70f21312 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:38.168697 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1438/2857] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:37 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:38.172486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa26b1-f74e-44a4-a53b-5987861f94c2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:38.182749 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa26b1-f74e-44a4-a53b-5987861f94c2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:38.187615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db994be4-5502-43bc-a8c2-73f4d13f4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:38.188239 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db994be4-5502-43bc-a8c2-73f4d13f4227 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:38.188532 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db994be4-5502-43bc-a8c2-73f4d13f4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:38.188800 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db994be4-5502-43bc-a8c2-73f4d13f4227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:38.189440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db994be4-5502-43bc-a8c2-73f4d13f4227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:38.191064 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db994be4-5502-43bc-a8c2-73f4d13f4227 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:38.201154 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1420/2858] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:38.207368 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc36ab6-2625-4717-9085-e7cb70f21312 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:38.217676 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc36ab6-2625-4717-9085-e7cb70f21312 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:38.222271 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076074c7-d360-4d72-a51e-a543df00f958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:38.222872 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076074c7-d360-4d72-a51e-a543df00f958 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:38.223146 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076074c7-d360-4d72-a51e-a543df00f958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:38.223419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076074c7-d360-4d72-a51e-a543df00f958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:38.224108 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076074c7-d360-4d72-a51e-a543df00f958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:38.225656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076074c7-d360-4d72-a51e-a543df00f958 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:38.235917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1439/2859] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:38.239913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db994be4-5502-43bc-a8c2-73f4d13f4227 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:38.251452 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db994be4-5502-43bc-a8c2-73f4d13f4227 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:38.256130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb6439-745d-4a1e-896c-935c9b233928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:38.256812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb6439-745d-4a1e-896c-935c9b233928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:38.257094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb6439-745d-4a1e-896c-935c9b233928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:38.257372 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb6439-745d-4a1e-896c-935c9b233928 admin admin] PATH_INFO: `/v3/projects/606d8b4d30d549fdac6e56695a69e6e5/users/578bc8223ce141f4a673a2e1d44e68bc/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:38.272493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb6439-745d-4a1e-896c-935c9b233928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606d8b4d30d549fdac6e56695a69e6e5, user_id=578bc8223ce141f4a673a2e1d44e68bc, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:38.275126 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb6439-745d-4a1e-896c-935c9b233928 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:38.367755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:38.373012 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1421/2860] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:38 2022] PUT /identity/v3/projects/606d8b4d30d549fdac6e56695a69e6e5/users/578bc8223ce141f4a673a2e1d44e68bc/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:38.384345 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c01cc3-14b3-423c-9dc2-a42e107698c0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:38.384630 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c01cc3-14b3-423c-9dc2-a42e107698c0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:38.384905 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c01cc3-14b3-423c-9dc2-a42e107698c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:38.414452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-96c01cc3-14b3-423c-9dc2-a42e107698c0 None None] MFA Rules not processed for user `578bc8223ce141f4a673a2e1d44e68bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:38.415671 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-96c01cc3-14b3-423c-9dc2-a42e107698c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:38.479116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1440/2861] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:38.484716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb6439-745d-4a1e-896c-935c9b233928 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:38.549138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb6439-745d-4a1e-896c-935c9b233928 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:38.553731 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a14be0-defe-4957-a9cc-0460ed327c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:38.554332 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a14be0-defe-4957-a9cc-0460ed327c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:38.554610 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a14be0-defe-4957-a9cc-0460ed327c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:38.554882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a14be0-defe-4957-a9cc-0460ed327c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:38.555513 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a14be0-defe-4957-a9cc-0460ed327c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:38.557436 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a14be0-defe-4957-a9cc-0460ed327c90 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:38.637002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1422/2862] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:38 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:38.641302 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c01cc3-14b3-423c-9dc2-a42e107698c0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:38.654875 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c01cc3-14b3-423c-9dc2-a42e107698c0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:38.711416 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79645d2c-8621-4724-bdf2-b189902c9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:38.712023 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79645d2c-8621-4724-bdf2-b189902c9429 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:38.712331 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79645d2c-8621-4724-bdf2-b189902c9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:38.712613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79645d2c-8621-4724-bdf2-b189902c9429 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:38.713249 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79645d2c-8621-4724-bdf2-b189902c9429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:38.715245 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79645d2c-8621-4724-bdf2-b189902c9429 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:38.834327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1441/2863] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:38 2022] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:30:38.838386 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a14be0-defe-4957-a9cc-0460ed327c90 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:38.848574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a14be0-defe-4957-a9cc-0460ed327c90 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:38.853226 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbbcbf-8f7c-4b42-b439-fee34d337351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:38.853821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbbcbf-8f7c-4b42-b439-fee34d337351 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:38.854127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbbcbf-8f7c-4b42-b439-fee34d337351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:38.854440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbbcbf-8f7c-4b42-b439-fee34d337351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:38.855090 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbbcbf-8f7c-4b42-b439-fee34d337351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:38.856744 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbbcbf-8f7c-4b42-b439-fee34d337351 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:38.867280 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1423/2864] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:38.871833 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79645d2c-8621-4724-bdf2-b189902c9429 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:38.881859 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79645d2c-8621-4724-bdf2-b189902c9429 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:38.887219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c142f9-d9b7-44e7-94d2-2b4dcfcbad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:38.887864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c142f9-d9b7-44e7-94d2-2b4dcfcbad88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:38.888166 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c142f9-d9b7-44e7-94d2-2b4dcfcbad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:38.888472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c142f9-d9b7-44e7-94d2-2b4dcfcbad88 admin admin] PATH_INFO: `/v3/projects/d13c2b7ef37a4f23a456c62443bd4c87/users/bd881cad2dbc4c198ba5655d942c0133/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:38.902969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c142f9-d9b7-44e7-94d2-2b4dcfcbad88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13c2b7ef37a4f23a456c62443bd4c87, user_id=bd881cad2dbc4c198ba5655d942c0133, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:38.905636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c142f9-d9b7-44e7-94d2-2b4dcfcbad88 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:38.983603 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1442/2865] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:38 2022] PUT /identity/v3/projects/d13c2b7ef37a4f23a456c62443bd4c87/users/bd881cad2dbc4c198ba5655d942c0133/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:38.987750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbbcbf-8f7c-4b42-b439-fee34d337351 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:38.998775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbbcbf-8f7c-4b42-b439-fee34d337351 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:39.054753 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28071e9a-5d7a-4310-acbe-ad158b21922a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:39.055286 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071e9a-5d7a-4310-acbe-ad158b21922a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:39.055925 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071e9a-5d7a-4310-acbe-ad158b21922a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:39.056203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071e9a-5d7a-4310-acbe-ad158b21922a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:39.056875 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28071e9a-5d7a-4310-acbe-ad158b21922a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:39.059101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28071e9a-5d7a-4310-acbe-ad158b21922a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:39.068870 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1424/2866] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:39.073076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c142f9-d9b7-44e7-94d2-2b4dcfcbad88 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:39.079940 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:39.083672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c142f9-d9b7-44e7-94d2-2b4dcfcbad88 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:39.088646 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba8390-6e00-47d1-91d5-e81c7850d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:39.089343 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8390-6e00-47d1-91d5-e81c7850d1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:39.089615 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8390-6e00-47d1-91d5-e81c7850d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:39.089887 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8390-6e00-47d1-91d5-e81c7850d1d8 admin admin] PATH_INFO: `/v3/projects/d13c2b7ef37a4f23a456c62443bd4c87/users/bd881cad2dbc4c198ba5655d942c0133/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:39.091811 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba8390-6e00-47d1-91d5-e81c7850d1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13c2b7ef37a4f23a456c62443bd4c87, user_id=bd881cad2dbc4c198ba5655d942c0133, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:39.094430 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba8390-6e00-47d1-91d5-e81c7850d1d8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:39.104315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1443/2867] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:39 2022] PUT /identity/v3/projects/d13c2b7ef37a4f23a456c62443bd4c87/users/bd881cad2dbc4c198ba5655d942c0133/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:39.114719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6283c-c744-458c-8633-f396cc64add2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:39.115260 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6283c-c744-458c-8633-f396cc64add2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:39.115540 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6283c-c744-458c-8633-f396cc64add2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:39.143392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e9a6283c-c744-458c-8633-f396cc64add2 None None] MFA Rules not processed for user `bd881cad2dbc4c198ba5655d942c0133`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:39.144675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e9a6283c-c744-458c-8633-f396cc64add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:39.205060 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:39.218163 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1425/2868] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:39.231832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba8390-6e00-47d1-91d5-e81c7850d1d8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:39.234340 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7bba8390-6e00-47d1-91d5-e81c7850d1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:39.294185 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba8390-6e00-47d1-91d5-e81c7850d1d8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:39.298091 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a393-e090-4e14-be75-7bd40e87c2a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:39.298775 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a393-e090-4e14-be75-7bd40e87c2a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:39.299050 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a393-e090-4e14-be75-7bd40e87c2a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:39.299321 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a393-e090-4e14-be75-7bd40e87c2a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:39.310064 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36a393-e090-4e14-be75-7bd40e87c2a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:39.311470 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36a393-e090-4e14-be75-7bd40e87c2a2 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:39.321047 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1444/2869] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:39 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:39.369804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6283c-c744-458c-8633-f396cc64add2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:39.371389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e9a6283c-c744-458c-8633-f396cc64add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:39.384082 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6283c-c744-458c-8633-f396cc64add2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:39.388155 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f599434-eead-4b19-b652-a1301c29d71e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:39.388861 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f599434-eead-4b19-b652-a1301c29d71e service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:39.389140 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f599434-eead-4b19-b652-a1301c29d71e service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:39.389427 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f599434-eead-4b19-b652-a1301c29d71e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:39.448871 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f599434-eead-4b19-b652-a1301c29d71e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:39.450317 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f599434-eead-4b19-b652-a1301c29d71e service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:39.459343 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1426/2870] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:45.146871 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a393-e090-4e14-be75-7bd40e87c2a2 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:45.210521 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a393-e090-4e14-be75-7bd40e87c2a2 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:45.215908 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:45.216557 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:45.216840 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:45.217115 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] PATH_INFO: `/v3/users/578bc8223ce141f4a673a2e1d44e68bc` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:45.218219 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578bc8223ce141f4a673a2e1d44e68bc)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:45.220116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:45.443179 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578bc8223ce141f4a673a2e1d44e68bc'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:45.450763 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578bc8223ce141f4a673a2e1d44e68bc'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:45.451552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578bc8223ce141f4a673a2e1d44e68bc'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:45.497900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578bc8223ce141f4a673a2e1d44e68bc'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:45.509750 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578bc8223ce141f4a673a2e1d44e68bc'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:45.516278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1445/2871] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:45 2022] DELETE /identity/v3/users/578bc8223ce141f4a673a2e1d44e68bc => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:45.520789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116f72-c3d5-4df1-8001-3c128ceb38ad None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:45.521276 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116f72-c3d5-4df1-8001-3c128ceb38ad None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:45.521390 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116f72-c3d5-4df1-8001-3c128ceb38ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:45.539766 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2c116f72-c3d5-4df1-8001-3c128ceb38ad None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:45.541066 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c116f72-c3d5-4df1-8001-3c128ceb38ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:45.599664 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1427/2872] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:45.609432 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:45.610843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:45.625567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:45.668328 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801fad5-89b1-40c2-8307-cde1a634cd86 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:45.671920 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6ed76-4762-49bf-8972-c41e212ef4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:45.672550 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6ed76-4762-49bf-8972-c41e212ef4db service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:45.672827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6ed76-4762-49bf-8972-c41e212ef4db service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:45.673095 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6ed76-4762-49bf-8972-c41e212ef4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:45.683544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6ed76-4762-49bf-8972-c41e212ef4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:45.685009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6ed76-4762-49bf-8972-c41e212ef4db service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:45.694825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1446/2873] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:46.099284 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c116f72-c3d5-4df1-8001-3c128ceb38ad None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:46.101820 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c116f72-c3d5-4df1-8001-3c128ceb38ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:46.114660 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c116f72-c3d5-4df1-8001-3c128ceb38ad None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:46.119651 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:46.120313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:46.120614 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:46.120890 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] PATH_INFO: `/v3/projects/606d8b4d30d549fdac6e56695a69e6e5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:46.122017 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] RBAC: Authorizing `identity:delete_project(project_id=606d8b4d30d549fdac6e56695a69e6e5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:46.124325 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:46.247550 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606d8b4d30d549fdac6e56695a69e6e5', 'request_id': 'req-0dc7df2e-1e79-4204-a47a-399a8777425c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:46.253548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606d8b4d30d549fdac6e56695a69e6e5', 'request_id': 'req-0dc7df2e-1e79-4204-a47a-399a8777425c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:46.259091 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606d8b4d30d549fdac6e56695a69e6e5', 'request_id': 'req-0dc7df2e-1e79-4204-a47a-399a8777425c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:46.342935 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] The token cache is being invalidate because project 606d8b4d30d549fdac6e56695a69e6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:46.343220 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:46.343859 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:46.345369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1428/2874] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:46 2022] DELETE /identity/v3/projects/606d8b4d30d549fdac6e56695a69e6e5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:46.349390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6ed76-4762-49bf-8972-c41e212ef4db service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:46.359350 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6ed76-4762-49bf-8972-c41e212ef4db service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:46.415391 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:46.416017 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:46.416319 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:46.416594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] PATH_INFO: `/v3/users/bd881cad2dbc4c198ba5655d942c0133` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:46.418390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd881cad2dbc4c198ba5655d942c0133)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:46.420307 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:46.591961 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd881cad2dbc4c198ba5655d942c0133'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:46.598625 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd881cad2dbc4c198ba5655d942c0133'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:46.599352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd881cad2dbc4c198ba5655d942c0133'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:46.680306 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd881cad2dbc4c198ba5655d942c0133'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:46.692709 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0385009f-ab09-47c4-8d2e-99f257a906f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd881cad2dbc4c198ba5655d942c0133'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:46.699019 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1447/2875] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:46 2022] DELETE /identity/v3/users/bd881cad2dbc4c198ba5655d942c0133 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:47.117962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:47.119546 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:47.133506 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7df2e-1e79-4204-a47a-399a8777425c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:47.145787 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:47.190924 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:47.191570 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:47.191878 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:47.192152 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] PATH_INFO: `/v3/projects/d13c2b7ef37a4f23a456c62443bd4c87` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:47.193319 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d13c2b7ef37a4f23a456c62443bd4c87)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:47.195233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:47.320838 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd13c2b7ef37a4f23a456c62443bd4c87', 'request_id': 'req-0276e55b-32e3-4f8d-a6fe-e41e02590047'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:47.326913 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd13c2b7ef37a4f23a456c62443bd4c87', 'request_id': 'req-0276e55b-32e3-4f8d-a6fe-e41e02590047'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:47.333003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd13c2b7ef37a4f23a456c62443bd4c87', 'request_id': 'req-0276e55b-32e3-4f8d-a6fe-e41e02590047'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:47.393486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] The token cache is being invalidate because project d13c2b7ef37a4f23a456c62443bd4c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:47.393804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:47.394421 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0276e55b-32e3-4f8d-a6fe-e41e02590047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:47.395893 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1429/2876] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:47 2022] DELETE /identity/v3/projects/d13c2b7ef37a4f23a456c62443bd4c87 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:47.400793 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd10524-77e4-4e70-a643-f4d45cd466ab None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:47.401295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd10524-77e4-4e70-a643-f4d45cd466ab None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:47.401387 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd10524-77e4-4e70-a643-f4d45cd466ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:47.422643 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7fd10524-77e4-4e70-a643-f4d45cd466ab None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:47.423850 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7fd10524-77e4-4e70-a643-f4d45cd466ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:47.454012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:47.482832 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1448/2877] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:47.491758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2d8cc-ca3e-4a23-af95-e0bbf137f51c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:47.492045 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2d8cc-ca3e-4a23-af95-e0bbf137f51c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:47.492380 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2d8cc-ca3e-4a23-af95-e0bbf137f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:47.512392 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-61d2d8cc-ca3e-4a23-af95-e0bbf137f51c None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:47.515362 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-61d2d8cc-ca3e-4a23-af95-e0bbf137f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:47.521582 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1430/2878] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:47.525851 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd10524-77e4-4e70-a643-f4d45cd466ab None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:47.535664 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd10524-77e4-4e70-a643-f4d45cd466ab None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:47.540201 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fb9df-ccfe-4c7f-8baa-4571f11070df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:47.541423 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fb9df-ccfe-4c7f-8baa-4571f11070df admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:47.541693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fb9df-ccfe-4c7f-8baa-4571f11070df admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:47.541963 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fb9df-ccfe-4c7f-8baa-4571f11070df admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:47.543127 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fb9df-ccfe-4c7f-8baa-4571f11070df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:30:47.543429 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fb9df-ccfe-4c7f-8baa-4571f11070df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:47.545030 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fb9df-ccfe-4c7f-8baa-4571f11070df admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:47.556476 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1449/2879] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 12:30:47.561183 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2d8cc-ca3e-4a23-af95-e0bbf137f51c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:47.570345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2d8cc-ca3e-4a23-af95-e0bbf137f51c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:47.575002 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e3885-b803-45f1-8e66-73b162042e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:47.575585 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e3885-b803-45f1-8e66-73b162042e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:47.575863 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e3885-b803-45f1-8e66-73b162042e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:47.576137 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e3885-b803-45f1-8e66-73b162042e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:47.576795 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e3885-b803-45f1-8e66-73b162042e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:47.578693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e3885-b803-45f1-8e66-73b162042e1f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:47.670867 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1431/2880] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:47 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:47.674879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fb9df-ccfe-4c7f-8baa-4571f11070df admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:47.685223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fb9df-ccfe-4c7f-8baa-4571f11070df admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:47.741708 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e42796-0853-46ee-b39f-c4eca087546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:47.742309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e42796-0853-46ee-b39f-c4eca087546a admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:47.742593 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e42796-0853-46ee-b39f-c4eca087546a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:47.742873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e42796-0853-46ee-b39f-c4eca087546a admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:47.743497 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e42796-0853-46ee-b39f-c4eca087546a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:47.745428 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e42796-0853-46ee-b39f-c4eca087546a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:47.880788 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1450/2881] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:47 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:47.884903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e3885-b803-45f1-8e66-73b162042e1f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:47.895013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e3885-b803-45f1-8e66-73b162042e1f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:47.899578 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e80e2e-79e5-48d0-a802-db007bbad8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:47.900166 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e80e2e-79e5-48d0-a802-db007bbad8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:47.900476 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e80e2e-79e5-48d0-a802-db007bbad8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:47.900750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e80e2e-79e5-48d0-a802-db007bbad8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:47.901396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e80e2e-79e5-48d0-a802-db007bbad8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:47.903558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e80e2e-79e5-48d0-a802-db007bbad8b1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:47.913613 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1432/2882] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:30:47.918063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e42796-0853-46ee-b39f-c4eca087546a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:47.927886 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e42796-0853-46ee-b39f-c4eca087546a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:47.932475 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c18b8f-1105-41bb-b1ed-fe96d06ab238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:47.933090 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c18b8f-1105-41bb-b1ed-fe96d06ab238 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:47.933374 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c18b8f-1105-41bb-b1ed-fe96d06ab238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:47.933650 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c18b8f-1105-41bb-b1ed-fe96d06ab238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:47.934295 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c18b8f-1105-41bb-b1ed-fe96d06ab238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:47.935862 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c18b8f-1105-41bb-b1ed-fe96d06ab238 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:47.946183 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1451/2883] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:47.949993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e80e2e-79e5-48d0-a802-db007bbad8b1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:47.959576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e80e2e-79e5-48d0-a802-db007bbad8b1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:47.964555 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a34a4-ff9f-4e2b-9f94-8695903d4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:47.965181 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a34a4-ff9f-4e2b-9f94-8695903d4a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:47.965460 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a34a4-ff9f-4e2b-9f94-8695903d4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:47.965735 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a34a4-ff9f-4e2b-9f94-8695903d4a6f admin admin] PATH_INFO: `/v3/projects/61f0763761c74e478b332d7e15d42dc7/users/025a99f332654cbd83db6ea5bfe5fc0f/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:47.979601 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a34a4-ff9f-4e2b-9f94-8695903d4a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f0763761c74e478b332d7e15d42dc7, user_id=025a99f332654cbd83db6ea5bfe5fc0f, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:47.982858 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a34a4-ff9f-4e2b-9f94-8695903d4a6f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:48.052191 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1433/2884] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:47 2022] PUT /identity/v3/projects/61f0763761c74e478b332d7e15d42dc7/users/025a99f332654cbd83db6ea5bfe5fc0f/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:48.062607 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b5dd-98da-4f82-b84e-7673ac35bb9b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:48.062894 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b5dd-98da-4f82-b84e-7673ac35bb9b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:48.063198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b5dd-98da-4f82-b84e-7673ac35bb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:48.091735 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d674b5dd-98da-4f82-b84e-7673ac35bb9b None None] MFA Rules not processed for user `025a99f332654cbd83db6ea5bfe5fc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:48.092972 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d674b5dd-98da-4f82-b84e-7673ac35bb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:48.156197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1452/2885] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:48.160738 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a34a4-ff9f-4e2b-9f94-8695903d4a6f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:48.204399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:48.221801 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a34a4-ff9f-4e2b-9f94-8695903d4a6f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:48.226298 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae1f2d-01c2-49fe-b497-35bf33083c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:48.227837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae1f2d-01c2-49fe-b497-35bf33083c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:48.227837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae1f2d-01c2-49fe-b497-35bf33083c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:48.227837 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae1f2d-01c2-49fe-b497-35bf33083c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:48.228124 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae1f2d-01c2-49fe-b497-35bf33083c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:48.230003 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae1f2d-01c2-49fe-b497-35bf33083c7e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:48.355707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1434/2886] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:48 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:48.359748 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b5dd-98da-4f82-b84e-7673ac35bb9b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:48.370825 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b5dd-98da-4f82-b84e-7673ac35bb9b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:48.398674 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:48.424509 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e15d6d-e106-4c60-92ea-838dcbaf4f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:48.425110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e15d6d-e106-4c60-92ea-838dcbaf4f87 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:48.425366 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e15d6d-e106-4c60-92ea-838dcbaf4f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:48.425636 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e15d6d-e106-4c60-92ea-838dcbaf4f87 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:48.435198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e15d6d-e106-4c60-92ea-838dcbaf4f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:48.435198 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e15d6d-e106-4c60-92ea-838dcbaf4f87 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:48.588567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1453/2887] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:48 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:48.592521 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae1f2d-01c2-49fe-b497-35bf33083c7e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:48.602693 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae1f2d-01c2-49fe-b497-35bf33083c7e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:48.618377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49835a-2b61-46f7-8cd2-8b794115e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:48.618377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49835a-2b61-46f7-8cd2-8b794115e1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:48.618377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49835a-2b61-46f7-8cd2-8b794115e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:48.618377 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49835a-2b61-46f7-8cd2-8b794115e1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:48.618843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49835a-2b61-46f7-8cd2-8b794115e1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:48.618843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49835a-2b61-46f7-8cd2-8b794115e1f5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:48.621999 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1435/2888] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:48.625906 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e15d6d-e106-4c60-92ea-838dcbaf4f87 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:48.636606 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e15d6d-e106-4c60-92ea-838dcbaf4f87 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:48.641238 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e77cc-27de-4adb-8d5e-c9b197f3983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:48.641914 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e77cc-27de-4adb-8d5e-c9b197f3983f admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:48.642199 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e77cc-27de-4adb-8d5e-c9b197f3983f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:48.642479 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e77cc-27de-4adb-8d5e-c9b197f3983f admin admin] PATH_INFO: `/v3/projects/ce15f34172e140b4a355ce5f4a189604/users/77376b4ab5f84c91a077d36f1a0e3e5a/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:48.657389 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e77cc-27de-4adb-8d5e-c9b197f3983f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce15f34172e140b4a355ce5f4a189604, user_id=77376b4ab5f84c91a077d36f1a0e3e5a, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:48.660039 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e77cc-27de-4adb-8d5e-c9b197f3983f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:48.771427 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1454/2889] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:48 2022] PUT /identity/v3/projects/ce15f34172e140b4a355ce5f4a189604/users/77376b4ab5f84c91a077d36f1a0e3e5a/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 12:30:48.775502 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49835a-2b61-46f7-8cd2-8b794115e1f5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:48.785783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49835a-2b61-46f7-8cd2-8b794115e1f5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:48.841302 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352d300-c09c-47ca-b66a-d724911adbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:48.841839 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d300-c09c-47ca-b66a-d724911adbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:48.842120 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d300-c09c-47ca-b66a-d724911adbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:48.842396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d300-c09c-47ca-b66a-d724911adbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:48.843069 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352d300-c09c-47ca-b66a-d724911adbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:48.844719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352d300-c09c-47ca-b66a-d724911adbb0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:48.854206 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1436/2890] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:48.858861 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e77cc-27de-4adb-8d5e-c9b197f3983f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:48.869722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e77cc-27de-4adb-8d5e-c9b197f3983f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:48.875070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6087e-9ecc-4274-98f2-b3ca21d584ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:48.875747 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6087e-9ecc-4274-98f2-b3ca21d584ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:48.876031 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6087e-9ecc-4274-98f2-b3ca21d584ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:48.876346 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6087e-9ecc-4274-98f2-b3ca21d584ae admin admin] PATH_INFO: `/v3/projects/ce15f34172e140b4a355ce5f4a189604/users/77376b4ab5f84c91a077d36f1a0e3e5a/roles/aee8b5d036dd4bec8d6aeae1d35e59a8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:48.878256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6087e-9ecc-4274-98f2-b3ca21d584ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce15f34172e140b4a355ce5f4a189604, user_id=77376b4ab5f84c91a077d36f1a0e3e5a, role_id=aee8b5d036dd4bec8d6aeae1d35e59a8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:48.880928 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6087e-9ecc-4274-98f2-b3ca21d584ae admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:48.891026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1455/2891] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:48 2022] PUT /identity/v3/projects/ce15f34172e140b4a355ce5f4a189604/users/77376b4ab5f84c91a077d36f1a0e3e5a/roles/aee8b5d036dd4bec8d6aeae1d35e59a8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:48.900910 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f141b3-9ce1-40b0-af76-590f7142817c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:48.901203 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f141b3-9ce1-40b0-af76-590f7142817c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:48.901485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f141b3-9ce1-40b0-af76-590f7142817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:48.928824 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-51f141b3-9ce1-40b0-af76-590f7142817c None None] MFA Rules not processed for user `77376b4ab5f84c91a077d36f1a0e3e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:48.930111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-51f141b3-9ce1-40b0-af76-590f7142817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:48.999138 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1437/2892] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:49.009745 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6087e-9ecc-4274-98f2-b3ca21d584ae admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:49.011604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-98c6087e-9ecc-4274-98f2-b3ca21d584ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:49.070162 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6087e-9ecc-4274-98f2-b3ca21d584ae admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:49.074139 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724aa0b-eb82-443f-a146-75950c4620e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:49.074734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724aa0b-eb82-443f-a146-75950c4620e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:49.075014 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724aa0b-eb82-443f-a146-75950c4620e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:49.075288 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724aa0b-eb82-443f-a146-75950c4620e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:49.084472 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724aa0b-eb82-443f-a146-75950c4620e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:49.085878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724aa0b-eb82-443f-a146-75950c4620e6 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:49.095929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1456/2893] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:49.203798 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f141b3-9ce1-40b0-af76-590f7142817c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:49.213558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f141b3-9ce1-40b0-af76-590f7142817c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:49.217675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef46c6d-a1f7-4d01-b8f8-3ee42a24ceec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:49.218279 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46c6d-a1f7-4d01-b8f8-3ee42a24ceec service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:49.218558 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46c6d-a1f7-4d01-b8f8-3ee42a24ceec service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:49.218832 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46c6d-a1f7-4d01-b8f8-3ee42a24ceec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:49.253812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:49.275819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46c6d-a1f7-4d01-b8f8-3ee42a24ceec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:49.277783 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46c6d-a1f7-4d01-b8f8-3ee42a24ceec service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:49.286576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1438/2894] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:52.334289 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724aa0b-eb82-443f-a146-75950c4620e6 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:52.396740 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724aa0b-eb82-443f-a146-75950c4620e6 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:52.401281 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:52.401903 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:52.402182 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:52.402456 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] PATH_INFO: `/v3/users/025a99f332654cbd83db6ea5bfe5fc0f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:52.403604 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=025a99f332654cbd83db6ea5bfe5fc0f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:52.405537 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:52.533828 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:52.631414 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025a99f332654cbd83db6ea5bfe5fc0f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:52.639106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025a99f332654cbd83db6ea5bfe5fc0f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:52.639783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025a99f332654cbd83db6ea5bfe5fc0f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:52.697501 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025a99f332654cbd83db6ea5bfe5fc0f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:52.710372 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025a99f332654cbd83db6ea5bfe5fc0f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:52.716504 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1457/2895] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:52 2022] DELETE /identity/v3/users/025a99f332654cbd83db6ea5bfe5fc0f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:52.721145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae09f14-ecfd-426b-a85f-c3a6e8a56b18 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:52.721626 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae09f14-ecfd-426b-a85f-c3a6e8a56b18 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:52.721726 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae09f14-ecfd-426b-a85f-c3a6e8a56b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:52.741170 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eae09f14-ecfd-426b-a85f-c3a6e8a56b18 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:52.742430 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eae09f14-ecfd-426b-a85f-c3a6e8a56b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:52.798797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1439/2896] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:52.809105 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:52.810495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:52.867335 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2d780-cdb6-4837-978e-fb644a33a7ed admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:52.870935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342742bb-f27f-4b32-bd55-64eaaeef5575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:52.871527 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342742bb-f27f-4b32-bd55-64eaaeef5575 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:52.871804 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342742bb-f27f-4b32-bd55-64eaaeef5575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:52.872076 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342742bb-f27f-4b32-bd55-64eaaeef5575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:52.880917 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342742bb-f27f-4b32-bd55-64eaaeef5575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:52.882400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342742bb-f27f-4b32-bd55-64eaaeef5575 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:52.891508 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1458/2897] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:30:53.299054 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae09f14-ecfd-426b-a85f-c3a6e8a56b18 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:53.300584 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eae09f14-ecfd-426b-a85f-c3a6e8a56b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:53.312567 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae09f14-ecfd-426b-a85f-c3a6e8a56b18 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:53.317313 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:53.317945 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:53.318222 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:53.318503 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] PATH_INFO: `/v3/projects/61f0763761c74e478b332d7e15d42dc7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:53.320022 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f0763761c74e478b332d7e15d42dc7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:53.321636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:53.434966 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f0763761c74e478b332d7e15d42dc7', 'request_id': 'req-900768d9-19c7-425d-bffc-8f7334d254bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:53.441094 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f0763761c74e478b332d7e15d42dc7', 'request_id': 'req-900768d9-19c7-425d-bffc-8f7334d254bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:53.446666 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f0763761c74e478b332d7e15d42dc7', 'request_id': 'req-900768d9-19c7-425d-bffc-8f7334d254bc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:53.532141 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] The token cache is being invalidate because project 61f0763761c74e478b332d7e15d42dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:53.532468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:53.533111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:53.534595 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1440/2898] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:53 2022] DELETE /identity/v3/projects/61f0763761c74e478b332d7e15d42dc7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:53.538544 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342742bb-f27f-4b32-bd55-64eaaeef5575 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:53.548434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342742bb-f27f-4b32-bd55-64eaaeef5575 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:53.604422 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:53.605055 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:53.605338 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:53.605613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] PATH_INFO: `/v3/users/77376b4ab5f84c91a077d36f1a0e3e5a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:53.606741 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77376b4ab5f84c91a077d36f1a0e3e5a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:53.608682 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:53.814018 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77376b4ab5f84c91a077d36f1a0e3e5a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:53.816012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:53.821309 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77376b4ab5f84c91a077d36f1a0e3e5a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:53.822087 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77376b4ab5f84c91a077d36f1a0e3e5a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:53.891655 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77376b4ab5f84c91a077d36f1a0e3e5a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:53.903923 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-17735f72-3250-43b9-8053-b95b7b5f1009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77376b4ab5f84c91a077d36f1a0e3e5a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:53.909866 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1459/2899] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:30:53 2022] DELETE /identity/v3/users/77376b4ab5f84c91a077d36f1a0e3e5a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:54.373675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:54.375167 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:54.388235 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900768d9-19c7-425d-bffc-8f7334d254bc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:54.445149 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:54.445791 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:54.446071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:54.446349 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] PATH_INFO: `/v3/projects/ce15f34172e140b4a355ce5f4a189604` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:54.447474 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce15f34172e140b4a355ce5f4a189604)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:54.449461 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:54.450949 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:54.577216 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce15f34172e140b4a355ce5f4a189604', 'request_id': 'req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:54.583849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce15f34172e140b4a355ce5f4a189604', 'request_id': 'req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:54.589834 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce15f34172e140b4a355ce5f4a189604', 'request_id': 'req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:54.702710 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] The token cache is being invalidate because project ce15f34172e140b4a355ce5f4a189604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:30:54.702998 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:54.703633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e4b6c19-18c9-4e30-9a1a-7b9ae5299ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:30:54.705354 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1441/2900] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:30:54 2022] DELETE /identity/v3/projects/ce15f34172e140b4a355ce5f4a189604 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:54.709936 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69d83-c4f9-4dc6-8b48-b15bf2379af5 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:54.710372 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69d83-c4f9-4dc6-8b48-b15bf2379af5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:54.710496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69d83-c4f9-4dc6-8b48-b15bf2379af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:54.731408 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6ea69d83-c4f9-4dc6-8b48-b15bf2379af5 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:54.732670 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6ea69d83-c4f9-4dc6-8b48-b15bf2379af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:54.791623 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1460/2901] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:54.855368 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceface-a618-4b8c-a105-53003b5a54fa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:54.855647 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceface-a618-4b8c-a105-53003b5a54fa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:54.855916 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceface-a618-4b8c-a105-53003b5a54fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:54.876727 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d5ceface-a618-4b8c-a105-53003b5a54fa None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:54.877923 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d5ceface-a618-4b8c-a105-53003b5a54fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:54.886414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1442/2902] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:54.890656 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea69d83-c4f9-4dc6-8b48-b15bf2379af5 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:54.900382 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea69d83-c4f9-4dc6-8b48-b15bf2379af5 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:54.905710 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ebe6b-b209-40d2-b5c0-f0002e78be54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:54.906305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ebe6b-b209-40d2-b5c0-f0002e78be54 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:54.906584 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ebe6b-b209-40d2-b5c0-f0002e78be54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:54.906857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ebe6b-b209-40d2-b5c0-f0002e78be54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:54.907503 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ebe6b-b209-40d2-b5c0-f0002e78be54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:30:54.907857 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ebe6b-b209-40d2-b5c0-f0002e78be54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:54.909493 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ebe6b-b209-40d2-b5c0-f0002e78be54 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:54.921217 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1461/2903] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:30:54.925589 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceface-a618-4b8c-a105-53003b5a54fa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:54.935044 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceface-a618-4b8c-a105-53003b5a54fa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:54.939849 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15542-12ae-4e07-9810-7bb520848c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:54.940468 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15542-12ae-4e07-9810-7bb520848c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:54.940812 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15542-12ae-4e07-9810-7bb520848c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:54.941210 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15542-12ae-4e07-9810-7bb520848c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:54.942134 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f15542-12ae-4e07-9810-7bb520848c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:54.944465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f15542-12ae-4e07-9810-7bb520848c91 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:55.069944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1443/2904] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:30:54 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:55.074684 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ebe6b-b209-40d2-b5c0-f0002e78be54 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:55.084693 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ebe6b-b209-40d2-b5c0-f0002e78be54 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:55.141232 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac3ccb-30b9-4f54-9465-a0685786b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:55.141836 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac3ccb-30b9-4f54-9465-a0685786b539 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:55.142116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac3ccb-30b9-4f54-9465-a0685786b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:55.142390 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac3ccb-30b9-4f54-9465-a0685786b539 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:55.143009 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac3ccb-30b9-4f54-9465-a0685786b539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:55.145118 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac3ccb-30b9-4f54-9465-a0685786b539 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:55.251730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1462/2905] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:30:55 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:30:55.255993 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15542-12ae-4e07-9810-7bb520848c91 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:55.266756 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15542-12ae-4e07-9810-7bb520848c91 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:55.271423 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9044777-aec2-4186-ba60-dee78aa9f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:55.272005 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9044777-aec2-4186-ba60-dee78aa9f69f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:55.272319 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9044777-aec2-4186-ba60-dee78aa9f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:55.272594 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9044777-aec2-4186-ba60-dee78aa9f69f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:55.273233 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9044777-aec2-4186-ba60-dee78aa9f69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:55.274804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9044777-aec2-4186-ba60-dee78aa9f69f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:55.285254 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1444/2906] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:55.288640 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac3ccb-30b9-4f54-9465-a0685786b539 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:55.298280 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac3ccb-30b9-4f54-9465-a0685786b539 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:55.302879 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ff2dd-ced5-43bd-979a-14181d2fa917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:55.303463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ff2dd-ced5-43bd-979a-14181d2fa917 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:55.303746 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ff2dd-ced5-43bd-979a-14181d2fa917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:55.304022 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ff2dd-ced5-43bd-979a-14181d2fa917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:55.304700 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ff2dd-ced5-43bd-979a-14181d2fa917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:55.306272 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ff2dd-ced5-43bd-979a-14181d2fa917 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:55.317158 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1463/2907] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:30:55.320988 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9044777-aec2-4186-ba60-dee78aa9f69f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:55.331389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9044777-aec2-4186-ba60-dee78aa9f69f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:55.336200 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f3b2b-c11a-4c0d-aedf-71d0610033b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:55.336852 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f3b2b-c11a-4c0d-aedf-71d0610033b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:55.337129 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f3b2b-c11a-4c0d-aedf-71d0610033b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:55.337405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f3b2b-c11a-4c0d-aedf-71d0610033b6 admin admin] PATH_INFO: `/v3/projects/b081712f0c5f43d484718713aa10eb1c/users/c07768d5a7994d82b14d4b91bc5e9d10/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:55.351385 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f3b2b-c11a-4c0d-aedf-71d0610033b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b081712f0c5f43d484718713aa10eb1c, user_id=c07768d5a7994d82b14d4b91bc5e9d10, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:55.354033 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f3b2b-c11a-4c0d-aedf-71d0610033b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:55.440758 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1445/2908] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:30:55 2022] PUT /identity/v3/projects/b081712f0c5f43d484718713aa10eb1c/users/c07768d5a7994d82b14d4b91bc5e9d10/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:30:55.451106 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132427f-7c8c-4054-8280-6cb0730daf70 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:55.451395 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132427f-7c8c-4054-8280-6cb0730daf70 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:55.451672 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132427f-7c8c-4054-8280-6cb0730daf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:55.479190 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f132427f-7c8c-4054-8280-6cb0730daf70 None None] MFA Rules not processed for user `c07768d5a7994d82b14d4b91bc5e9d10`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:30:55.480935 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f132427f-7c8c-4054-8280-6cb0730daf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:55.501448 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:30:55.546512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1464/2909] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:30:55.558308 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f3b2b-c11a-4c0d-aedf-71d0610033b6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:30:55.559972 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ad8f3b2b-c11a-4c0d-aedf-71d0610033b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:30:55.615050 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f3b2b-c11a-4c0d-aedf-71d0610033b6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:30:55.618641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471ed8c-1610-41a2-b35a-20d44f2fcf3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:30:55.619269 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ed8c-1610-41a2-b35a-20d44f2fcf3b service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:30:55.619548 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ed8c-1610-41a2-b35a-20d44f2fcf3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:30:55.619856 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471ed8c-1610-41a2-b35a-20d44f2fcf3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:30:55.628465 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471ed8c-1610-41a2-b35a-20d44f2fcf3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:30:55.629883 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471ed8c-1610-41a2-b35a-20d44f2fcf3b service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:30:55.638719 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1446/2910] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:30:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:31:05.577764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=17 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:31:05.634554 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:31:12.448356 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132427f-7c8c-4054-8280-6cb0730daf70 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:12.510070 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132427f-7c8c-4054-8280-6cb0730daf70 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:12.514549 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:12.515176 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:12.515460 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:12.515736 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] PATH_INFO: `/v3/users/c07768d5a7994d82b14d4b91bc5e9d10` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:12.516933 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07768d5a7994d82b14d4b91bc5e9d10)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:12.518843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:12.751258 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07768d5a7994d82b14d4b91bc5e9d10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:12.758231 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07768d5a7994d82b14d4b91bc5e9d10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:12.758931 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07768d5a7994d82b14d4b91bc5e9d10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:12.805681 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07768d5a7994d82b14d4b91bc5e9d10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:12.818571 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07768d5a7994d82b14d4b91bc5e9d10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:12.824551 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1465/2911] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:31:12 2022] DELETE /identity/v3/users/c07768d5a7994d82b14d4b91bc5e9d10 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:31:12.829262 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5244f-38e2-49d6-bfb1-5caf67ce5550 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:12.829736 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5244f-38e2-49d6-bfb1-5caf67ce5550 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:12.829841 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5244f-38e2-49d6-bfb1-5caf67ce5550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:12.848405 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-70d5244f-38e2-49d6-bfb1-5caf67ce5550 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:31:12.849706 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-70d5244f-38e2-49d6-bfb1-5caf67ce5550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:12.907324 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1447/2912] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:31:12.917524 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:12.918564 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:12.974400 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f253ff-d4b0-487e-a599-0fc2f1f23e3e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:12.977864 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644656d-dac6-432d-8768-2138100f79b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:12.978451 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644656d-dac6-432d-8768-2138100f79b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:12.978728 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644656d-dac6-432d-8768-2138100f79b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:12.978996 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644656d-dac6-432d-8768-2138100f79b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:12.988305 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644656d-dac6-432d-8768-2138100f79b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:12.989989 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644656d-dac6-432d-8768-2138100f79b4 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:12.999119 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1466/2913] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 12:31:13.424384 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5244f-38e2-49d6-bfb1-5caf67ce5550 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:13.425821 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-70d5244f-38e2-49d6-bfb1-5caf67ce5550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:13.437995 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5244f-38e2-49d6-bfb1-5caf67ce5550 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:13.442827 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:13.449414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:13.449414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:13.449414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] PATH_INFO: `/v3/projects/b081712f0c5f43d484718713aa10eb1c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:13.449414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b081712f0c5f43d484718713aa10eb1c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:13.449414 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:13.553971 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b081712f0c5f43d484718713aa10eb1c', 'request_id': 'req-747978c1-d25e-47cb-9248-2aca28983442'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:13.559956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b081712f0c5f43d484718713aa10eb1c', 'request_id': 'req-747978c1-d25e-47cb-9248-2aca28983442'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:13.565387 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b081712f0c5f43d484718713aa10eb1c', 'request_id': 'req-747978c1-d25e-47cb-9248-2aca28983442'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:13.633406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] The token cache is being invalidate because project b081712f0c5f43d484718713aa10eb1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:31:13.633691 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:13.634302 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-747978c1-d25e-47cb-9248-2aca28983442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:13.635791 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1448/2914] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:31:13 2022] DELETE /identity/v3/projects/b081712f0c5f43d484718713aa10eb1c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:31:13.641299 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9e3e2-b9b1-4151-8039-a1c793c7f90b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:13.642364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9e3e2-b9b1-4151-8039-a1c793c7f90b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:13.642364 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9e3e2-b9b1-4151-8039-a1c793c7f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:13.663160 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8fc9e3e2-b9b1-4151-8039-a1c793c7f90b None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:31:13.664434 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8fc9e3e2-b9b1-4151-8039-a1c793c7f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:13.681519 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:31:13.724807 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1467/2915] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:31:13.733879 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb473c-c9c5-46ce-be2f-693adf4f46e6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:13.737947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb473c-c9c5-46ce-be2f-693adf4f46e6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:13.737947 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb473c-c9c5-46ce-be2f-693adf4f46e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:13.754911 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a8cb473c-c9c5-46ce-be2f-693adf4f46e6 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:31:13.756111 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8cb473c-c9c5-46ce-be2f-693adf4f46e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:13.763986 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1449/2916] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 12:31:13.768734 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9e3e2-b9b1-4151-8039-a1c793c7f90b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:13.778197 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9e3e2-b9b1-4151-8039-a1c793c7f90b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:13.783657 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2f3eb-1436-4280-90a5-1a499ea27046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:13.784274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f3eb-1436-4280-90a5-1a499ea27046 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:13.784555 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f3eb-1436-4280-90a5-1a499ea27046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:13.784829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f3eb-1436-4280-90a5-1a499ea27046 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:13.785473 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2f3eb-1436-4280-90a5-1a499ea27046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:31:13.785774 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2f3eb-1436-4280-90a5-1a499ea27046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:13.787352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2f3eb-1436-4280-90a5-1a499ea27046 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:13.798813 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1468/2917] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:31:13.802991 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb473c-c9c5-46ce-be2f-693adf4f46e6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:13.814607 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb473c-c9c5-46ce-be2f-693adf4f46e6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:13.817649 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017386ce-f1d4-46b7-9acf-9245cd61c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:13.818245 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017386ce-f1d4-46b7-9acf-9245cd61c2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:13.818526 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017386ce-f1d4-46b7-9acf-9245cd61c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:13.818797 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017386ce-f1d4-46b7-9acf-9245cd61c2c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:13.819428 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017386ce-f1d4-46b7-9acf-9245cd61c2c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:13.821391 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017386ce-f1d4-46b7-9acf-9245cd61c2c6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:13.903944 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1450/2918] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:31:13 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:31:13.908180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2f3eb-1436-4280-90a5-1a499ea27046 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:13.918180 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2f3eb-1436-4280-90a5-1a499ea27046 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:13.972680 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98756f60-c601-4e95-9f47-20f78edf7c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:13.973274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98756f60-c601-4e95-9f47-20f78edf7c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:13.973552 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98756f60-c601-4e95-9f47-20f78edf7c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:13.973826 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98756f60-c601-4e95-9f47-20f78edf7c50 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:13.974463 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98756f60-c601-4e95-9f47-20f78edf7c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:13.976385 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98756f60-c601-4e95-9f47-20f78edf7c50 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:14.039803 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1469/2919] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:31:13 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 12:31:14.043965 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017386ce-f1d4-46b7-9acf-9245cd61c2c6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:14.054080 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017386ce-f1d4-46b7-9acf-9245cd61c2c6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:14.058583 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3206bfe-1a6b-42f9-b329-a44b2bb70702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:14.059170 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206bfe-1a6b-42f9-b329-a44b2bb70702 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:14.059451 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206bfe-1a6b-42f9-b329-a44b2bb70702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:14.059716 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206bfe-1a6b-42f9-b329-a44b2bb70702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:14.060388 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3206bfe-1a6b-42f9-b329-a44b2bb70702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:14.063293 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3206bfe-1a6b-42f9-b329-a44b2bb70702 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:14.072615 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1451/2920] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:31:14.076419 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98756f60-c601-4e95-9f47-20f78edf7c50 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:14.086910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98756f60-c601-4e95-9f47-20f78edf7c50 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:14.091592 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81462d-9706-4d6a-8a0e-89ea1e3d3096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:14.092188 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81462d-9706-4d6a-8a0e-89ea1e3d3096 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:14.092516 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81462d-9706-4d6a-8a0e-89ea1e3d3096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:14.092796 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81462d-9706-4d6a-8a0e-89ea1e3d3096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:14.093438 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81462d-9706-4d6a-8a0e-89ea1e3d3096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:14.095010 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81462d-9706-4d6a-8a0e-89ea1e3d3096 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:14.105789 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1470/2921] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:31:14.110048 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3206bfe-1a6b-42f9-b329-a44b2bb70702 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:14.120145 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3206bfe-1a6b-42f9-b329-a44b2bb70702 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:14.125403 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f978e-0233-4b3c-8ed8-e73aa166746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:14.126039 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f978e-0233-4b3c-8ed8-e73aa166746b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:14.126321 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f978e-0233-4b3c-8ed8-e73aa166746b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:14.126600 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f978e-0233-4b3c-8ed8-e73aa166746b admin admin] PATH_INFO: `/v3/projects/fc1b4900cf474188be7d7c8dcdbe50b8/users/315b0d6431e546489ebe2ebd5ae14b19/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:14.140775 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f978e-0233-4b3c-8ed8-e73aa166746b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1b4900cf474188be7d7c8dcdbe50b8, user_id=315b0d6431e546489ebe2ebd5ae14b19, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:14.143395 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f978e-0233-4b3c-8ed8-e73aa166746b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:14.222464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1452/2922] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:31:14 2022] PUT /identity/v3/projects/fc1b4900cf474188be7d7c8dcdbe50b8/users/315b0d6431e546489ebe2ebd5ae14b19/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:31:14.232732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e8966-dcdf-49fc-9d38-b9c1c9b1e2e7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:14.233026 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e8966-dcdf-49fc-9d38-b9c1c9b1e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:14.233352 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e8966-dcdf-49fc-9d38-b9c1c9b1e2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:14.261756 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e40e8966-dcdf-49fc-9d38-b9c1c9b1e2e7 None None] MFA Rules not processed for user `315b0d6431e546489ebe2ebd5ae14b19`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:31:14.262949 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e40e8966-dcdf-49fc-9d38-b9c1c9b1e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:14.326436 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1471/2923] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:31:14.337331 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f978e-0233-4b3c-8ed8-e73aa166746b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:14.339101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cb8f978e-0233-4b3c-8ed8-e73aa166746b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:14.360659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:31:14.396709 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f978e-0233-4b3c-8ed8-e73aa166746b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:14.400370 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40445b65-ef6f-45a0-b86c-b7dbda304af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:14.400967 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445b65-ef6f-45a0-b86c-b7dbda304af3 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:14.401244 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445b65-ef6f-45a0-b86c-b7dbda304af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:14.401518 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445b65-ef6f-45a0-b86c-b7dbda304af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:14.409740 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40445b65-ef6f-45a0-b86c-b7dbda304af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:14.411151 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40445b65-ef6f-45a0-b86c-b7dbda304af3 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:14.420621 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1453/2924] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:31:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:31:24.323485 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:31:24.451172 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=17 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:31:53.035151 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e8966-dcdf-49fc-9d38-b9c1c9b1e2e7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:53.096087 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e8966-dcdf-49fc-9d38-b9c1c9b1e2e7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:53.100573 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:53.101186 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:53.101462 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:53.101730 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] PATH_INFO: `/v3/users/315b0d6431e546489ebe2ebd5ae14b19` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:53.102827 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=315b0d6431e546489ebe2ebd5ae14b19)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:53.104743 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:53.263929 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315b0d6431e546489ebe2ebd5ae14b19'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:53.270706 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315b0d6431e546489ebe2ebd5ae14b19'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:53.271375 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315b0d6431e546489ebe2ebd5ae14b19'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:53.341768 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315b0d6431e546489ebe2ebd5ae14b19'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:53.354878 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315b0d6431e546489ebe2ebd5ae14b19'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:53.360843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1472/2925] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:31:53 2022] DELETE /identity/v3/users/315b0d6431e546489ebe2ebd5ae14b19 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:31:53.365684 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36edefd-675e-40ec-bbc3-25c2127b3ebb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:53.366171 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36edefd-675e-40ec-bbc3-25c2127b3ebb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:53.366843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36edefd-675e-40ec-bbc3-25c2127b3ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:53.385977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c36edefd-675e-40ec-bbc3-25c2127b3ebb None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:31:53.387247 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c36edefd-675e-40ec-bbc3-25c2127b3ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:53.444903 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1454/2926] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:31:53.454669 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:53.456132 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:53.513061 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ec82-41a4-4469-8fcc-fbd9c5aa1c85 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:53.516773 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe819a-1802-447d-8408-11552ee57f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:53.517313 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe819a-1802-447d-8408-11552ee57f90 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:53.517591 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe819a-1802-447d-8408-11552ee57f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:53.517863 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe819a-1802-447d-8408-11552ee57f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:53.526644 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe819a-1802-447d-8408-11552ee57f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:53.528059 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe819a-1802-447d-8408-11552ee57f90 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:53.537252 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1473/2927] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:31:53.921296 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36edefd-675e-40ec-bbc3-25c2127b3ebb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:53.922728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c36edefd-675e-40ec-bbc3-25c2127b3ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:53.937653 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36edefd-675e-40ec-bbc3-25c2127b3ebb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:53.941435 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:53.942067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:53.942345 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:53.942618 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] PATH_INFO: `/v3/projects/fc1b4900cf474188be7d7c8dcdbe50b8` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:53.943728 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1b4900cf474188be7d7c8dcdbe50b8)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:53.945659 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:54.061572 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1b4900cf474188be7d7c8dcdbe50b8', 'request_id': 'req-541656b8-1ebe-4fe0-ba26-1317ca00831c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:54.067665 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1b4900cf474188be7d7c8dcdbe50b8', 'request_id': 'req-541656b8-1ebe-4fe0-ba26-1317ca00831c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:54.073919 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1b4900cf474188be7d7c8dcdbe50b8', 'request_id': 'req-541656b8-1ebe-4fe0-ba26-1317ca00831c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:54.146206 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] The token cache is being invalidate because project fc1b4900cf474188be7d7c8dcdbe50b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:31:54.146493 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:54.147101 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-541656b8-1ebe-4fe0-ba26-1317ca00831c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:31:54.149263 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1455/2928] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:31:53 2022] DELETE /identity/v3/projects/fc1b4900cf474188be7d7c8dcdbe50b8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:31:54.154229 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3b908-008a-490b-a642-4b2a4a2c16c2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:54.154735 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3b908-008a-490b-a642-4b2a4a2c16c2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:54.154843 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3b908-008a-490b-a642-4b2a4a2c16c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:54.173809 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-41c3b908-008a-490b-a642-4b2a4a2c16c2 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:31:54.174985 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-41c3b908-008a-490b-a642-4b2a4a2c16c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:54.191760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:31:54.233202 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1474/2929] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:31:54.242737 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c94dd-5ded-417e-b276-47cb75a74504 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:54.243067 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c94dd-5ded-417e-b276-47cb75a74504 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:54.243396 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c94dd-5ded-417e-b276-47cb75a74504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:54.264417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-457c94dd-5ded-417e-b276-47cb75a74504 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:31:54.265633 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-457c94dd-5ded-417e-b276-47cb75a74504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:54.274359 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1456/2930] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:31:54.278722 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3b908-008a-490b-a642-4b2a4a2c16c2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:54.288404 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3b908-008a-490b-a642-4b2a4a2c16c2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:54.293063 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c2a3d-17cf-4d2d-929a-6f0cf7db33c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:54.293663 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c2a3d-17cf-4d2d-929a-6f0cf7db33c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:54.293945 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c2a3d-17cf-4d2d-929a-6f0cf7db33c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:54.294223 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c2a3d-17cf-4d2d-929a-6f0cf7db33c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:54.294907 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c2a3d-17cf-4d2d-929a-6f0cf7db33c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 12:31:54.295215 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c2a3d-17cf-4d2d-929a-6f0cf7db33c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:54.296840 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c2a3d-17cf-4d2d-929a-6f0cf7db33c9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:54.308383 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1475/2931] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Sep 1 12:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 12:31:54.312406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c94dd-5ded-417e-b276-47cb75a74504 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:54.321977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c94dd-5ded-417e-b276-47cb75a74504 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:54.326574 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236af27-7b21-4707-a063-f7d6cca8c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:54.327211 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236af27-7b21-4707-a063-f7d6cca8c707 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:54.327486 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236af27-7b21-4707-a063-f7d6cca8c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:54.327755 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236af27-7b21-4707-a063-f7d6cca8c707 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:54.328491 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236af27-7b21-4707-a063-f7d6cca8c707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:54.330389 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236af27-7b21-4707-a063-f7d6cca8c707 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:54.422734 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1457/2932] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Sep 1 12:31:54 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:31:54.426816 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c2a3d-17cf-4d2d-929a-6f0cf7db33c9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:54.437997 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c2a3d-17cf-4d2d-929a-6f0cf7db33c9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:54.495561 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72d155-c71e-4812-a89c-69da23259d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:54.496154 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72d155-c71e-4812-a89c-69da23259d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:54.496461 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72d155-c71e-4812-a89c-69da23259d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:54.496732 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72d155-c71e-4812-a89c-69da23259d61 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:54.497355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72d155-c71e-4812-a89c-69da23259d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:54.499234 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72d155-c71e-4812-a89c-69da23259d61 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:54.598927 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1476/2933] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Sep 1 12:31:54 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 12:31:54.603810 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236af27-7b21-4707-a063-f7d6cca8c707 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:54.614657 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236af27-7b21-4707-a063-f7d6cca8c707 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:54.619328 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692d8e2-7793-4109-81a5-9703bb857dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:54.619914 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692d8e2-7793-4109-81a5-9703bb857dca admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:54.620192 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692d8e2-7793-4109-81a5-9703bb857dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:54.620488 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692d8e2-7793-4109-81a5-9703bb857dca admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:54.621127 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692d8e2-7793-4109-81a5-9703bb857dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:54.622695 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692d8e2-7793-4109-81a5-9703bb857dca admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:54.632359 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1458/2934] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 12:31:54.636274 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72d155-c71e-4812-a89c-69da23259d61 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:54.646113 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72d155-c71e-4812-a89c-69da23259d61 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:54.651594 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28724422-3076-43de-93fe-230f62f01a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:54.652257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28724422-3076-43de-93fe-230f62f01a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:54.652573 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28724422-3076-43de-93fe-230f62f01a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:54.652848 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28724422-3076-43de-93fe-230f62f01a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:54.653512 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28724422-3076-43de-93fe-230f62f01a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:54.655116 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28724422-3076-43de-93fe-230f62f01a17 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:54.667694 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1477/2935] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Sep 1 12:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 12:31:54.671714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692d8e2-7793-4109-81a5-9703bb857dca admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:54.681707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692d8e2-7793-4109-81a5-9703bb857dca admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:54.687399 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df5610-fc4e-47a1-a8ff-ea9e3e961e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:54.688337 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df5610-fc4e-47a1-a8ff-ea9e3e961e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:54.688831 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df5610-fc4e-47a1-a8ff-ea9e3e961e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:54.689115 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df5610-fc4e-47a1-a8ff-ea9e3e961e9f admin admin] PATH_INFO: `/v3/projects/fdd176acfbae4a2193c107cd901c7b52/users/851501fdf752479cb385dae63f6eda86/roles/4a2e97979a4c4cd796f797f81fff095a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:54.706641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df5610-fc4e-47a1-a8ff-ea9e3e961e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd176acfbae4a2193c107cd901c7b52, user_id=851501fdf752479cb385dae63f6eda86, role_id=4a2e97979a4c4cd796f797f81fff095a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:54.709406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df5610-fc4e-47a1-a8ff-ea9e3e961e9f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:54.793406 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1459/2936] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Sep 1 12:31:54 2022] PUT /identity/v3/projects/fdd176acfbae4a2193c107cd901c7b52/users/851501fdf752479cb385dae63f6eda86/roles/4a2e97979a4c4cd796f797f81fff095a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:31:54.803629 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a8a80-590e-4819-a279-ba7baf1679e6 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:54.803896 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a8a80-590e-4819-a279-ba7baf1679e6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:54.804194 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a8a80-590e-4819-a279-ba7baf1679e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:54.831293 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0a4a8a80-590e-4819-a279-ba7baf1679e6 None None] MFA Rules not processed for user `851501fdf752479cb385dae63f6eda86`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:31:54.832539 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0a4a8a80-590e-4819-a279-ba7baf1679e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:54.897334 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1478/2937] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:31:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:31:54.909424 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df5610-fc4e-47a1-a8ff-ea9e3e961e9f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:31:54.911116 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-80df5610-fc4e-47a1-a8ff-ea9e3e961e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:31:54.932533 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:31:54.967312 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df5610-fc4e-47a1-a8ff-ea9e3e961e9f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:31:54.970984 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d9264-7a4f-4845-8ff3-c40ba6db311a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb45915b43b471a84fbd363fade7241', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:31:54.971580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d9264-7a4f-4845-8ff3-c40ba6db311a service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:31:54.971857 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d9264-7a4f-4845-8ff3-c40ba6db311a service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:31:54.972130 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d9264-7a4f-4845-8ff3-c40ba6db311a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:31:54.980165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d9264-7a4f-4845-8ff3-c40ba6db311a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:31:54.981598 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d9264-7a4f-4845-8ff3-c40ba6db311a service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:31:54.990357 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1460/2938] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:31:54 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:32:00.797323 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a8a80-590e-4819-a279-ba7baf1679e6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:32:00.816490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:32:00.858760 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a8a80-590e-4819-a279-ba7baf1679e6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:32:00.863626 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:32:00.864268 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:32:00.864553 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:32:00.864829 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] PATH_INFO: `/v3/users/851501fdf752479cb385dae63f6eda86` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:32:00.865991 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851501fdf752479cb385dae63f6eda86)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:32:00.868567 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:32:01.052200 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851501fdf752479cb385dae63f6eda86'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:32:01.059575 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851501fdf752479cb385dae63f6eda86'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:32:01.060452 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851501fdf752479cb385dae63f6eda86'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:32:01.141440 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851501fdf752479cb385dae63f6eda86'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:32:01.154278 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851501fdf752479cb385dae63f6eda86'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:32:01.160685 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1479/2939] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:32:00 2022] DELETE /identity/v3/users/851501fdf752479cb385dae63f6eda86 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:32:01.165962 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f9968-2c90-4a39-98b9-2c993cedaac7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:32:01.166447 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f9968-2c90-4a39-98b9-2c993cedaac7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:32:01.166549 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f9968-2c90-4a39-98b9-2c993cedaac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:32:01.185784 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-aa5f9968-2c90-4a39-98b9-2c993cedaac7 None None] MFA Rules not processed for user `05e7d4149924497faf197737573abc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:32:01.186956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa5f9968-2c90-4a39-98b9-2c993cedaac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:32:01.244604 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1461/2940] 10.222.0.18 () {58 vars in 958 bytes} [Thu Sep 1 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:32:01.259910 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:32:01.261513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:32:01.320783 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e39e7-c077-4d55-8d87-61128058c864 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:32:01.324455 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb50934-807e-4f89-ae30-d07cee5cd7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0eb27228bae4b6d97715c0c46032030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:32:01.325060 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb50934-807e-4f89-ae30-d07cee5cd7cc service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:32:01.325339 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb50934-807e-4f89-ae30-d07cee5cd7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:32:01.325613 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb50934-807e-4f89-ae30-d07cee5cd7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:32:01.334582 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb50934-807e-4f89-ae30-d07cee5cd7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:32:01.337208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb50934-807e-4f89-ae30-d07cee5cd7cc service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:32:01.345885 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1480/2941] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:32:01.772243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f9968-2c90-4a39-98b9-2c993cedaac7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:32:01.773750 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-aa5f9968-2c90-4a39-98b9-2c993cedaac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:32:01.786117 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f9968-2c90-4a39-98b9-2c993cedaac7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:32:01.790804 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:32:01.791439 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:32:01.791714 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:32:01.791983 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] PATH_INFO: `/v3/projects/fdd176acfbae4a2193c107cd901c7b52` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:32:01.793118 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd176acfbae4a2193c107cd901c7b52)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:32:01.795001 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:32:01.896160 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd176acfbae4a2193c107cd901c7b52', 'request_id': 'req-49258fc0-a0c9-4734-a584-103b2e759560'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:32:01.902446 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd176acfbae4a2193c107cd901c7b52', 'request_id': 'req-49258fc0-a0c9-4734-a584-103b2e759560'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:32:01.907819 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd176acfbae4a2193c107cd901c7b52', 'request_id': 'req-49258fc0-a0c9-4734-a584-103b2e759560'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:32:01.974938 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] The token cache is being invalidate because project fdd176acfbae4a2193c107cd901c7b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:32:01.975230 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:32:01.975850 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:32:01.977422 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1462/2942] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:32:01 2022] DELETE /identity/v3/projects/fdd176acfbae4a2193c107cd901c7b52 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:32:11.341667 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:32:11.971843 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:32:26.308821 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb50934-807e-4f89-ae30-d07cee5cd7cc service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:32:26.310265 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3bb50934-807e-4f89-ae30-d07cee5cd7cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:32:26.378639 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb50934-807e-4f89-ae30-d07cee5cd7cc service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:32:26.436484 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d81ef7-e957-4524-95c9-f40f6137854e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:32:26.437082 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d81ef7-e957-4524-95c9-f40f6137854e service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:32:26.437362 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d81ef7-e957-4524-95c9-f40f6137854e service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:32:26.437632 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d81ef7-e957-4524-95c9-f40f6137854e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:32:26.439355 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b4d81ef7-e957-4524-95c9-f40f6137854e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:32:26.450820 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d81ef7-e957-4524-95c9-f40f6137854e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:32:26.452386 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d81ef7-e957-4524-95c9-f40f6137854e service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:32:26.462083 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1481/2943] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:32:36.457873 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=58 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:32:49.276733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:32:49.279576 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:32:49.366707 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258fc0-a0c9-4734-a584-103b2e759560 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:32:49.372165 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bf96d-71ce-4ccc-b80c-155d3cd21c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7790d6ec0e524ee6a31fd06fda9c4ac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:32:49.372806 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bf96d-71ce-4ccc-b80c-155d3cd21c3d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:32:49.373071 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bf96d-71ce-4ccc-b80c-155d3cd21c3d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:32:49.373340 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bf96d-71ce-4ccc-b80c-155d3cd21c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:32:49.375121 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-df0bf96d-71ce-4ccc-b80c-155d3cd21c3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:32:49.388641 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bf96d-71ce-4ccc-b80c-155d3cd21c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:32:49.390217 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bf96d-71ce-4ccc-b80c-155d3cd21c3d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:32:49.401464 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1463/2944] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:32:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:32:57.254241 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567905e2-ff4d-4aac-8d3f-e9d96b6e6d3d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:32:57.254691 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567905e2-ff4d-4aac-8d3f-e9d96b6e6d3d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:32:57.254791 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567905e2-ff4d-4aac-8d3f-e9d96b6e6d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:32:57.274327 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-567905e2-ff4d-4aac-8d3f-e9d96b6e6d3d None None] MFA Rules not processed for user `9b9457f6eebd49e7858158a1706ec99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 12:32:57.275513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-567905e2-ff4d-4aac-8d3f-e9d96b6e6d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:32:57.328867 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1482/2945] 10.222.0.18 () {58 vars in 967 bytes} [Thu Sep 1 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 12:32:57.368580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bf96d-71ce-4ccc-b80c-155d3cd21c3d service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:32:57.369997 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-df0bf96d-71ce-4ccc-b80c-155d3cd21c3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:32:57.437803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bf96d-71ce-4ccc-b80c-155d3cd21c3d service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:32:57.442701 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977827a-3063-4455-9863-729083c3b0e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a59a4732ec14a838be9c838dbeb7fd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:32:57.443300 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977827a-3063-4455-9863-729083c3b0e3 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:32:57.443580 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977827a-3063-4455-9863-729083c3b0e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:32:57.443855 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977827a-3063-4455-9863-729083c3b0e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:32:57.452309 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977827a-3063-4455-9863-729083c3b0e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:32:57.453876 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977827a-3063-4455-9863-729083c3b0e3 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:32:57.461760 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1464/2946] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Sep 1 12:32:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 12:33:01.859256 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567905e2-ff4d-4aac-8d3f-e9d96b6e6d3d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:33:01.861111 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-567905e2-ff4d-4aac-8d3f-e9d96b6e6d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:33:01.875634 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567905e2-ff4d-4aac-8d3f-e9d96b6e6d3d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:33:01.880602 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ad371-b8d8-4957-b00d-798cbe180d5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:33:01.881208 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ad371-b8d8-4957-b00d-798cbe180d5f service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:33:01.881490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ad371-b8d8-4957-b00d-798cbe180d5f service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:33:01.881764 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ad371-b8d8-4957-b00d-798cbe180d5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:33:01.883496 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-048ad371-b8d8-4957-b00d-798cbe180d5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:33:01.895711 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ad371-b8d8-4957-b00d-798cbe180d5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:33:01.901257 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ad371-b8d8-4957-b00d-798cbe180d5f service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:33:01.908653 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1483/2947] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:33:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:33:05.593252 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977827a-3063-4455-9863-729083c3b0e3 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:33:05.597237 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b977827a-3063-4455-9863-729083c3b0e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:33:05.659675 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977827a-3063-4455-9863-729083c3b0e3 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:33:05.664243 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:33:05.664877 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:33:05.665164 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:33:05.665440 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] PATH_INFO: `/v3/users/18dbef22f86a4a56ada3a86175d576e2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:33:05.666561 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18dbef22f86a4a56ada3a86175d576e2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:33:05.668564 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:33:05.684789 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:33:05.793485 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18dbef22f86a4a56ada3a86175d576e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:05.801303 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18dbef22f86a4a56ada3a86175d576e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:05.871733 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18dbef22f86a4a56ada3a86175d576e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:05.872369 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18dbef22f86a4a56ada3a86175d576e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:05.872977 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18dbef22f86a4a56ada3a86175d576e2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:05.890636 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1465/2948] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:33:05 2022] DELETE /identity/v3/users/18dbef22f86a4a56ada3a86175d576e2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:33:06.136191 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ad371-b8d8-4957-b00d-798cbe180d5f service placement] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:33:06.147495 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ad371-b8d8-4957-b00d-798cbe180d5f service placement] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:33:06.207568 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:33:06.208196 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:33:06.208513 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:33:06.208780 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] PATH_INFO: `/v3/projects/34d2c97e5b5543a09c35f55eb342dd3f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:33:06.209900 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d2c97e5b5543a09c35f55eb342dd3f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:33:06.211785 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:33:06.323048 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d2c97e5b5543a09c35f55eb342dd3f', 'request_id': 'req-6e60f30b-3995-45e9-a282-4f5a6d47845b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:06.329806 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d2c97e5b5543a09c35f55eb342dd3f', 'request_id': 'req-6e60f30b-3995-45e9-a282-4f5a6d47845b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:06.418469 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d2c97e5b5543a09c35f55eb342dd3f', 'request_id': 'req-6e60f30b-3995-45e9-a282-4f5a6d47845b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:06.429876 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] The token cache is being invalidate because project 34d2c97e5b5543a09c35f55eb342dd3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:33:06.430167 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:06.430802 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:06.432315 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1484/2949] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:33:06 2022] DELETE /identity/v3/projects/34d2c97e5b5543a09c35f55eb342dd3f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:33:06.437013 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:33:06.438517 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:33:06.452031 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febacad3-e75a-4fc2-a695-e54bd9c61094 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:33:06.508882 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:33:06.509507 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:33:06.509788 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:33:06.510061 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] PATH_INFO: `/v3/users/38a37160a31b4fe7ab14cec45c5efe3b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:33:06.511302 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a37160a31b4fe7ab14cec45c5efe3b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:33:06.513250 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:33:06.672989 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a37160a31b4fe7ab14cec45c5efe3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:06.679796 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a37160a31b4fe7ab14cec45c5efe3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:06.755761 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a37160a31b4fe7ab14cec45c5efe3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:06.756417 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a37160a31b4fe7ab14cec45c5efe3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:06.757053 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a37160a31b4fe7ab14cec45c5efe3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:06.774545 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1466/2950] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Sep 1 12:33:06 2022] DELETE /identity/v3/users/38a37160a31b4fe7ab14cec45c5efe3b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:33:07.038948 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:33:07.040490 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:33:07.053899 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60f30b-3995-45e9-a282-4f5a6d47845b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:33:07.072500 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:33:07.113012 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05e7d4149924497faf197737573abc5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa27a3f862749599654d7d59ff48c18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:33:07.113637 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:33:07.113969 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:33:07.114165 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] PATH_INFO: `/v3/projects/d127e53a12bc402cb808642e2b74dfbd` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:33:07.115294 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d127e53a12bc402cb808642e2b74dfbd)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:33:07.117226 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:33:07.236542 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd127e53a12bc402cb808642e2b74dfbd', 'request_id': 'req-8b70e544-0628-4f72-802e-6541c9e0b0ef'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:07.242718 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd127e53a12bc402cb808642e2b74dfbd', 'request_id': 'req-8b70e544-0628-4f72-802e-6541c9e0b0ef'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:07.323203 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd127e53a12bc402cb808642e2b74dfbd', 'request_id': 'req-8b70e544-0628-4f72-802e-6541c9e0b0ef'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:07.334280 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] The token cache is being invalidate because project d127e53a12bc402cb808642e2b74dfbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 12:33:07.334570 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:07.335189 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b70e544-0628-4f72-802e-6541c9e0b0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 12:33:07.336714 dv-cinder-839768-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1485/2951] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Sep 1 12:33:07 2022] DELETE /identity/v3/projects/d127e53a12bc402cb808642e2b74dfbd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 12:33:16.771092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=19,keystone:SELECT=73,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:33:17.331110 dv-cinder-839768-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 12:37:30.306652 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 12:37:30.308092 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:37:30.445034 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014296e0-a981-459f-9b23-8b6b8feb3262 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 12:37:30.503361 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121e157-c619-4fe5-9271-623a4780e19c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81919eaf832b4025a2118feb4e7fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39853b73f16840a9aac4e60ccb8cccc7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 12:37:30.503956 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121e157-c619-4fe5-9271-623a4780e19c service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 12:37:30.504256 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121e157-c619-4fe5-9271-623a4780e19c service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 12:37:30.504535 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121e157-c619-4fe5-9271-623a4780e19c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 12:37:30.506265 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f121e157-c619-4fe5-9271-623a4780e19c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 12:37:30.517205 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121e157-c619-4fe5-9271-623a4780e19c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 12:37:30.518803 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121e157-c619-4fe5-9271-623a4780e19c service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 12:37:30.528648 dv-cinder-839768-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1467/2952] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Sep 1 12:37:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 12:37:40.524433 dv-cinder-839768-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}